[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:19:44 dist-test-slave-g170 krb5kdc[16339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:19:44 dist-test-slave-g170 krb5kdc[16339](info): set up 2 sockets
Aug 07 15:19:44 dist-test-slave-g170 krb5kdc[16339](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 15:19:45.317224 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:19:45 dist-test-slave-g170 krb5kdc[16339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:19:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:19:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:19:45.461006 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38521
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:42703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:45.578131 16357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:45.578418 16357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:45.578495 16357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:45.582602 16357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:19:45.582661 16357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:45.582690 16357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:45.582738 16357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:19:45.582780 16357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:19:45.588212 16357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:42703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:45.589344 16357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:45.590368 16357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:45.600536 16364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:45.600632 16357 server_base.cc:1034] running on GCE node
W20260807 15:19:45.600539 16367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:45.600539 16365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:45.601652 16357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:45.602774 16357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:45.603991 16357 hybrid_clock.cc:648] HybridClock initialized: now 1786115985603915 us; error 88 us; skew 500 ppm
Aug 07 15:19:45 dist-test-slave-g170 krb5kdc[16339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115985, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:45.607267 16357 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:19:45.608341 16357 webserver.cc:460] Webserver started at http://127.15.242.254:36797/ using document root <none> and password file <none>
I20260807 15:19:45.609031 16357 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:45.609133 16357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:45.609397 16357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:45.611718 16357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "a4024f75eb61480b98f8954303be4482"
format_stamp: "Formatted at 2026-08-07 15:19:45 on dist-test-slave-g170"
server_key: "d3e7797963ffc45ad37ba0840e9ebd5a"
server_key_iv: "268ee88bf6139f9e97a33210a2627603"
server_key_version: "encryptionkey@0"
I20260807 15:19:45.612339 16357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "a4024f75eb61480b98f8954303be4482"
format_stamp: "Formatted at 2026-08-07 15:19:45 on dist-test-slave-g170"
server_key: "d3e7797963ffc45ad37ba0840e9ebd5a"
server_key_iv: "268ee88bf6139f9e97a33210a2627603"
server_key_version: "encryptionkey@0"
I20260807 15:19:45.616521 16357 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260807 15:19:45.619148 16381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:45.620560 16357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:45.620875 16357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "a4024f75eb61480b98f8954303be4482"
format_stamp: "Formatted at 2026-08-07 15:19:45 on dist-test-slave-g170"
server_key: "d3e7797963ffc45ad37ba0840e9ebd5a"
server_key_iv: "268ee88bf6139f9e97a33210a2627603"
server_key_version: "encryptionkey@0"
I20260807 15:19:45.621011 16357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:45.647935 16357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:45.651597 16357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:45.651863 16357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:45.659793 16357 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38521
I20260807 15:19:45.659864 16469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38521 every 8 connection(s)
I20260807 15:19:45.660831 16357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:19:45.663790 16471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:45.668512 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16357
I20260807 15:19:45.668679 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:19:45.670192 16471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482: Bootstrap starting.
I20260807 15:19:45.670421 16331 external_mini_cluster.cc:1428] Setting key f9cd535349d5ee70f9518aae24b49770
I20260807 15:19:45.673400 16471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:45.674305 16471 log.cc:824] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:45.676440 16471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482: No bootstrap required, opened a new log
I20260807 15:19:45.681084 16471 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4024f75eb61480b98f8954303be4482" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38521 } }
I20260807 15:19:45.681366 16471 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:45.681433 16471 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4024f75eb61480b98f8954303be4482, State: Initialized, Role: FOLLOWER
I20260807 15:19:45.681941 16471 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4024f75eb61480b98f8954303be4482" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38521 } }
I20260807 15:19:45.682137 16471 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:19:45.682227 16471 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:19:45.682360 16471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:45.683396 16471 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4024f75eb61480b98f8954303be4482" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38521 } }
I20260807 15:19:45.683794 16471 leader_election.cc:302] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4024f75eb61480b98f8954303be4482; no voters:
I20260807 15:19:45.684227 16471 leader_election.cc:288] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:19:45.684319 16477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:45.684556 16477 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [term 1 LEADER]: Becoming Leader. State: Replica: a4024f75eb61480b98f8954303be4482, State: Running, Role: LEADER
I20260807 15:19:45.684919 16477 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4024f75eb61480b98f8954303be4482" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38521 } }
I20260807 15:19:45.685712 16471 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:19:45.686890 16478 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4024f75eb61480b98f8954303be4482" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4024f75eb61480b98f8954303be4482" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38521 } } }
I20260807 15:19:45.687047 16478 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [sys.catalog]: This master's current role is: LEADER
I20260807 15:19:45.687361 16480 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4024f75eb61480b98f8954303be4482. Latest consensus state: current_term: 1 leader_uuid: "a4024f75eb61480b98f8954303be4482" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4024f75eb61480b98f8954303be4482" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38521 } } }
I20260807 15:19:45.687489 16480 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482 [sys.catalog]: This master's current role is: LEADER
I20260807 15:19:45.687839 16489 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:19:45.691812 16489 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 15:19:45 dist-test-slave-g170 krb5kdc[16339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:45.698261 16489 catalog_manager.cc:1347] Generated new cluster ID: 7b0f00e4e84c474cb49013bdfdf428ea
I20260807 15:19:45.698357 16489 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:19:45.700156 16473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:45.674141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53306 (local address 127.15.242.254:38521)
0807 15:19:45.674732 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:45.674756 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:45.675763 (+ 1007us) server_negotiation.cc:407] Connection header received
0807 15:19:45.680595 (+ 4832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:45.680618 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:45.681055 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:45.681447 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:45.684091 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:45.685444 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:45.687214 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:45.687954 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:45.688098 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:45.693740 (+ 5642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:45.693754 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:45.693767 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:45.693799 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:45.695737 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:45.696899 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:45.696911 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:45.696916 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:45.697040 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:45.697428 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:45.697431 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:45.697432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:45.698017 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:45.698251 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:45.698933 (+ 682us) server_negotiation.cc:299] Negotiation successful
0807 15:19:45.699226 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":141,"threads_started":1}
I20260807 15:19:45.720590 16489 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:19:45.721724 16489 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:19:45.735306 16489 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4024f75eb61480b98f8954303be4482: Generated new TSK 0
I20260807 15:19:45.736208 16489 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:19:45.776985 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38521
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:42703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:45.927855 16506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:45.928359 16506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:45.928463 16506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:45.937638 16506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:45.937753 16506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:45.937918 16506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:19:45.947396 16506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:42703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38521
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:45.949045 16506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:45.950595 16506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:45.964202 16516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:45.964193 16515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:45.964540 16506 server_base.cc:1034] running on GCE node
W20260807 15:19:45.964671 16518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:45.965325 16506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:45.966200 16506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:45.967449 16506 hybrid_clock.cc:648] HybridClock initialized: now 1786115985967428 us; error 48 us; skew 500 ppm
Aug 07 15:19:45 dist-test-slave-g170 krb5kdc[16339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115985, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:45.970835 16506 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:19:45.971896 16506 webserver.cc:460] Webserver started at http://127.15.242.193:33069/ using document root <none> and password file <none>
I20260807 15:19:45.972537 16506 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:45.972602 16506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:45.972903 16506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:45.975389 16506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "00c77ae04a344a989f59449ebd90c49d"
format_stamp: "Formatted at 2026-08-07 15:19:45 on dist-test-slave-g170"
server_key: "0ba46e9969f226acbed80f13dbd2c05a"
server_key_iv: "c188a228ce4ec3b9b9a0a03a77a7ec75"
server_key_version: "encryptionkey@0"
I20260807 15:19:45.975991 16506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "00c77ae04a344a989f59449ebd90c49d"
format_stamp: "Formatted at 2026-08-07 15:19:45 on dist-test-slave-g170"
server_key: "0ba46e9969f226acbed80f13dbd2c05a"
server_key_iv: "c188a228ce4ec3b9b9a0a03a77a7ec75"
server_key_version: "encryptionkey@0"
I20260807 15:19:45.985914 16506 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.007s sys 0.000s
I20260807 15:19:45.989866 16528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:45.991597 16506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260807 15:19:45.991755 16506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "00c77ae04a344a989f59449ebd90c49d"
format_stamp: "Formatted at 2026-08-07 15:19:45 on dist-test-slave-g170"
server_key: "0ba46e9969f226acbed80f13dbd2c05a"
server_key_iv: "c188a228ce4ec3b9b9a0a03a77a7ec75"
server_key_version: "encryptionkey@0"
I20260807 15:19:45.991911 16506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:46.015120 16506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:46.018839 16506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:46.019032 16506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:46.019681 16506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:19:46.020599 16506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:46.020656 16506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:46.020704 16506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:46.020722 16506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:46.031311 16506 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:44719
I20260807 15:19:46.031744 16708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:44719 every 8 connection(s)
I20260807 15:19:46.032254 16506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:19:46.032745 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16506
I20260807 15:19:46.032899 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:19:46.033207 16331 external_mini_cluster.cc:1428] Setting key 218e44b343d80c8694f22539f1f8ea70
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115985, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:19:46.050859 16473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:46.034722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:34199 (local address 127.15.242.254:38521)
0807 15:19:46.034890 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:46.034895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:46.036109 (+ 1214us) server_negotiation.cc:407] Connection header received
0807 15:19:46.037729 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:46.037737 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:46.037813 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:46.037927 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:46.039600 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.040156 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.042390 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.042836 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.042975 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:46.045936 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:46.045940 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:46.045943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:46.045982 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:46.047837 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.048545 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.048549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.048551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.048700 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.049267 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.049274 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.049279 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.049564 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:46.049670 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:46.050526 (+ 856us) server_negotiation.cc:299] Negotiation successful
0807 15:19:46.050717 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 15:19:46.052093 16715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:46.035294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38521 (local address 127.15.242.193:34199)
0807 15:19:46.035907 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:46.035975 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:46.037365 (+ 1390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:46.038163 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:46.038171 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:46.038615 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:46.039335 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:46.039362 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.040322 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.040329 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:46.042158 (+ 1829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:46.042174 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.043053 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.043058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:46.043259 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:46.043996 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:46.044016 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:46.045737 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:46.047987 (+ 2250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:46.047993 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:46.048008 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:46.048425 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:46.048925 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:46.048928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:46.048929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:46.049141 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:46.049770 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:46.049782 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:46.050190 (+ 408us) client_negotiation.cc:769] Sending connection context
0807 15:19:46.050440 (+ 250us) client_negotiation.cc:240] Negotiation successful
0807 15:19:46.050897 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":150,"threads_started":1}
I20260807 15:19:46.053665 16709 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38521
I20260807 15:19:46.053936 16709 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:46.054597 16709 heartbeater.cc:511] Master 127.15.242.254:38521 requested a full tablet report, sending...
I20260807 15:19:46.056270 16412 ts_manager.cc:194] Registered new tserver with Master: 00c77ae04a344a989f59449ebd90c49d (127.15.242.193:44719)
I20260807 15:19:46.057592 16412 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:34199
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:19:46.068010 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38521
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:42703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:46.185353 16718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:46.185602 16718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:46.185657 16718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:46.190011 16718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:46.190073 16718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:46.190163 16718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:19:46.195437 16718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:42703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38521
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:46.196518 16718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:46.197724 16718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:46.207726 16725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:46.207901 16728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:46.207726 16726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:46.208171 16718 server_base.cc:1034] running on GCE node
I20260807 15:19:46.208608 16718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:46.209395 16718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:46.210594 16718 hybrid_clock.cc:648] HybridClock initialized: now 1786115986210584 us; error 42 us; skew 500 ppm
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115986, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:46.213495 16718 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:19:46.214434 16718 webserver.cc:460] Webserver started at http://127.15.242.194:40625/ using document root <none> and password file <none>
I20260807 15:19:46.214973 16718 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:46.215032 16718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:46.215201 16718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:46.217252 16718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "5ed383bfa10e4efa982338d7680d6357"
format_stamp: "Formatted at 2026-08-07 15:19:46 on dist-test-slave-g170"
server_key: "8b753454f829ab60cc2ce2442aa31aa9"
server_key_iv: "2db45a42b9df1c4201dc88325af5534d"
server_key_version: "encryptionkey@0"
I20260807 15:19:46.217777 16718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "5ed383bfa10e4efa982338d7680d6357"
format_stamp: "Formatted at 2026-08-07 15:19:46 on dist-test-slave-g170"
server_key: "8b753454f829ab60cc2ce2442aa31aa9"
server_key_iv: "2db45a42b9df1c4201dc88325af5534d"
server_key_version: "encryptionkey@0"
I20260807 15:19:46.221556 16718 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:19:46.224025 16741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:46.225513 16718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:46.225663 16718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "5ed383bfa10e4efa982338d7680d6357"
format_stamp: "Formatted at 2026-08-07 15:19:46 on dist-test-slave-g170"
server_key: "8b753454f829ab60cc2ce2442aa31aa9"
server_key_iv: "2db45a42b9df1c4201dc88325af5534d"
server_key_version: "encryptionkey@0"
I20260807 15:19:46.225757 16718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:46.242018 16718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:46.245062 16718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:46.245265 16718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:46.245882 16718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:19:46.246730 16718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:46.246776 16718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:46.246842 16718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:46.246881 16718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:46.256490 16718 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:41679
I20260807 15:19:46.256533 16913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:41679 every 8 connection(s)
I20260807 15:19:46.257421 16718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:19:46.265817 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16718
I20260807 15:19:46.265931 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:19:46.266263 16331 external_mini_cluster.cc:1428] Setting key a15f1e7ed203814ae606c86e00893083
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115986, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:46.274246 16473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:46.259409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:47681 (local address 127.15.242.254:38521)
0807 15:19:46.259598 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:46.259602 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:46.260389 (+ 787us) server_negotiation.cc:407] Connection header received
0807 15:19:46.261888 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:46.261891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:46.261940 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:46.262015 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:46.263265 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.263790 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.265097 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.265325 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.265409 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:46.268818 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:46.268825 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:46.268831 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:46.268864 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:46.271123 (+ 2259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.271954 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.271959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.271962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.272094 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.272577 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.272580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.272582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.272922 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:46.273059 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:46.273853 (+ 794us) server_negotiation.cc:299] Negotiation successful
0807 15:19:46.274048 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 15:19:46.275610 16917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:46.259742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38521 (local address 127.15.242.194:47681)
0807 15:19:46.260222 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:46.260267 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:46.261673 (+ 1406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:46.262217 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:46.262223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:46.262606 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:46.263108 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:46.263134 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.263940 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.263943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:46.264964 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:46.264975 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.265547 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.265557 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:46.265823 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:46.266582 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:46.266605 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:46.268575 (+ 1970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:46.271291 (+ 2716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:46.271301 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:46.271322 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:46.271761 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:46.272226 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:46.272233 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:46.272236 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:46.272450 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:46.273128 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:46.273146 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:46.273504 (+ 358us) client_negotiation.cc:769] Sending connection context
0807 15:19:46.273726 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 15:19:46.274101 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":125,"threads_started":1}
I20260807 15:19:46.277455 16914 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38521
I20260807 15:19:46.277770 16914 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:46.278326 16914 heartbeater.cc:511] Master 127.15.242.254:38521 requested a full tablet report, sending...
I20260807 15:19:46.279461 16412 ts_manager.cc:194] Registered new tserver with Master: 5ed383bfa10e4efa982338d7680d6357 (127.15.242.194:41679)
I20260807 15:19:46.280043 16412 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:47681
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:19:46.301081 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38521
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:42703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:46.434208 16923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:46.434515 16923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:46.434566 16923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:46.438920 16923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:46.438987 16923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:46.439072 16923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:19:46.444437 16923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:42703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38521
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:46.445570 16923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:46.446647 16923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:46.457273 16940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:46.457252 16935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:46.457360 16923 server_base.cc:1034] running on GCE node
W20260807 15:19:46.457657 16938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:46.458133 16923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:46.458915 16923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:46.460129 16923 hybrid_clock.cc:648] HybridClock initialized: now 1786115986460111 us; error 32 us; skew 500 ppm
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115986, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:46.463754 16923 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:19:46.464745 16923 webserver.cc:460] Webserver started at http://127.15.242.195:34513/ using document root <none> and password file <none>
I20260807 15:19:46.465433 16923 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:46.465536 16923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:46.465806 16923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:46.468040 16923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "9c59e47ca1ae4592a6df5345b3df854b"
format_stamp: "Formatted at 2026-08-07 15:19:46 on dist-test-slave-g170"
server_key: "d69b47d5742b5932302119abccf6be63"
server_key_iv: "73dc449522600cd670658b0b297f6a64"
server_key_version: "encryptionkey@0"
I20260807 15:19:46.468672 16923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "9c59e47ca1ae4592a6df5345b3df854b"
format_stamp: "Formatted at 2026-08-07 15:19:46 on dist-test-slave-g170"
server_key: "d69b47d5742b5932302119abccf6be63"
server_key_iv: "73dc449522600cd670658b0b297f6a64"
server_key_version: "encryptionkey@0"
I20260807 15:19:46.472878 16923 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:19:46.475519 16948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:46.476883 16923 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:46.477012 16923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "9c59e47ca1ae4592a6df5345b3df854b"
format_stamp: "Formatted at 2026-08-07 15:19:46 on dist-test-slave-g170"
server_key: "d69b47d5742b5932302119abccf6be63"
server_key_iv: "73dc449522600cd670658b0b297f6a64"
server_key_version: "encryptionkey@0"
I20260807 15:19:46.477124 16923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:46.487182 16923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:46.490453 16923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:46.490660 16923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:46.491257 16923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:19:46.492087 16923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:46.492136 16923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:46.492205 16923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:46.492237 16923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:46.501858 16923 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:39777
I20260807 15:19:46.501883 17122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:39777 every 8 connection(s)
I20260807 15:19:46.502822 16923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:19:46.509279 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16923
I20260807 15:19:46.509409 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:19:46.509778 16331 external_mini_cluster.cc:1428] Setting key fcb16dff5e0173181a0b3381e6dc9449
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115986, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:46.517534 16473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:46.504611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:60583 (local address 127.15.242.254:38521)
0807 15:19:46.504809 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:46.504815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:46.505715 (+ 900us) server_negotiation.cc:407] Connection header received
0807 15:19:46.507022 (+ 1307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:46.507025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:46.507074 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:46.507152 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:46.508378 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.509008 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.510700 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.511019 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.511113 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:46.514119 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:46.514134 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:46.514136 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:46.514161 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:46.515419 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.515991 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.515994 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.515995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.516069 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.516429 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.516431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.516432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.516611 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:46.516690 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:46.517314 (+ 624us) server_negotiation.cc:299] Negotiation successful
0807 15:19:46.517412 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 15:19:46.518440 17126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:46.505063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38521 (local address 127.15.242.195:60583)
0807 15:19:46.505544 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:46.505587 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:46.506798 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:46.507332 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:46.507339 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:46.507701 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:46.508175 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:46.508188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.509164 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.509170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:46.510581 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:46.510593 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.511447 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.511452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:46.511649 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:46.512290 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:46.512315 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:46.513952 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:46.515556 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:46.515562 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:46.515578 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:46.515889 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:46.516163 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:46.516165 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:46.516167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:46.516336 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:46.516743 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:46.516749 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:46.517074 (+ 325us) client_negotiation.cc:769] Sending connection context
0807 15:19:46.517257 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 15:19:46.517532 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":115,"threads_started":1}
I20260807 15:19:46.519819 17124 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38521
I20260807 15:19:46.520043 17124 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:46.520506 17124 heartbeater.cc:511] Master 127.15.242.254:38521 requested a full tablet report, sending...
I20260807 15:19:46.521965 16412 ts_manager.cc:194] Registered new tserver with Master: 9c59e47ca1ae4592a6df5345b3df854b (127.15.242.195:39777)
I20260807 15:19:46.522644 16412 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:60583
I20260807 15:19:46.524986 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115986, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115986, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:19:46.555980 17132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:46.545600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51996 (local address 127.15.242.193:44719)
0807 15:19:46.545994 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:46.546014 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:46.546061 (+ 47us) server_negotiation.cc:407] Connection header received
0807 15:19:46.546141 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:46.546146 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:46.546343 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:46.546531 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:46.547305 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.548170 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.549080 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.549456 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.549577 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:46.552198 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:46.552208 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:46.552221 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:46.552245 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:46.554144 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.554571 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.554576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.554577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.554708 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.554958 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.554961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.554962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.555225 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:46.555392 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:46.555650 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 15:19:46.555821 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":148,"threads_started":1}
W20260807 15:19:46.557080 16569 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51996
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[16339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:19:46.587958 17132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:46.577722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52000 (local address 127.15.242.193:44719)
0807 15:19:46.577893 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:46.577899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:46.578040 (+ 141us) server_negotiation.cc:407] Connection header received
0807 15:19:46.578252 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:46.578256 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:46.578303 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:46.578424 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:46.579226 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.579791 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.580748 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:46.581080 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:46.581231 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:46.583907 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:46.583910 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:46.583913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:46.583937 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:46.585398 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.585819 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.585822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.585823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.585904 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:46.586361 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:46.586367 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:46.586369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:46.586610 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:46.586818 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:46.587266 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 15:19:46.587556 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 15:19:46.589433 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16506
I20260807 15:19:46.614333 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16718
I20260807 15:19:46.640090 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16923
I20260807 15:19:46.677366 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16357
2026-08-07T15:19:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2687 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[17145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[17145](info): set up 2 sockets
Aug 07 15:19:46 dist-test-slave-g170 krb5kdc[17145](info): commencing operation
krb5kdc: starting...
W20260807 15:19:48.012888 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:19:48 dist-test-slave-g170 krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:19:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:19:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:19:48.153182 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:42959
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:34567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:42959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:48.276014 17176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:48.276455 17176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:48.276543 17176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:48.280967 17176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:19:48.281020 17176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:48.281040 17176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:48.281057 17176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:19:48.281072 17176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:19:48.286360 17176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:34567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:42959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:42959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:48.287325 17176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:48.288283 17176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:48.296988 17183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:48.297034 17186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:48.297039 17184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:48.297636 17176 server_base.cc:1034] running on GCE node
I20260807 15:19:48.298156 17176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:48.299247 17176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:48.300444 17176 hybrid_clock.cc:648] HybridClock initialized: now 1786115988300423 us; error 34 us; skew 500 ppm
Aug 07 15:19:48 dist-test-slave-g170 krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115988, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:48.303458 17176 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:19:48.304430 17176 webserver.cc:460] Webserver started at http://127.15.242.254:33807/ using document root <none> and password file <none>
I20260807 15:19:48.305119 17176 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:48.305214 17176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:48.305464 17176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:48.307816 17176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "f9c9283a6957415d824c56b6fa8f3dc4"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "16dd0a13c2bda1c3d3113d543461a4ed"
server_key_iv: "234582a85313f1a37d5e76bdc2881713"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.308435 17176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "f9c9283a6957415d824c56b6fa8f3dc4"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "16dd0a13c2bda1c3d3113d543461a4ed"
server_key_iv: "234582a85313f1a37d5e76bdc2881713"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.312439 17176 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 15:19:48.315121 17198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:48.316382 17176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:19:48.316531 17176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "f9c9283a6957415d824c56b6fa8f3dc4"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "16dd0a13c2bda1c3d3113d543461a4ed"
server_key_iv: "234582a85313f1a37d5e76bdc2881713"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.316650 17176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:48.338469 17176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:48.342123 17176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:48.342355 17176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:48.350416 17176 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:42959
I20260807 15:19:48.350458 17275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:42959 every 8 connection(s)
I20260807 15:19:48.351449 17176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:19:48.354598 17277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:48.360811 17277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4: Bootstrap starting.
I20260807 15:19:48.361685 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17176
I20260807 15:19:48.361775 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:19:48.362039 16331 external_mini_cluster.cc:1428] Setting key 3cf72039e8978be9f93b177e1e4b8ec7
I20260807 15:19:48.363950 17277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:48.364949 17277 log.cc:824] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:48.367069 17277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4: No bootstrap required, opened a new log
I20260807 15:19:48.370299 17277 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9c9283a6957415d824c56b6fa8f3dc4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42959 } }
I20260807 15:19:48.370568 17277 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:48.370671 17277 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9c9283a6957415d824c56b6fa8f3dc4, State: Initialized, Role: FOLLOWER
I20260807 15:19:48.371266 17277 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9c9283a6957415d824c56b6fa8f3dc4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42959 } }
I20260807 15:19:48.371454 17277 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:19:48.371551 17277 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:19:48.371686 17277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:48.372902 17277 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9c9283a6957415d824c56b6fa8f3dc4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42959 } }
Aug 07 15:19:48 dist-test-slave-g170 krb5kdc[17145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:48.373317 17277 leader_election.cc:302] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9c9283a6957415d824c56b6fa8f3dc4; no voters:
I20260807 15:19:48.373765 17277 leader_election.cc:288] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:19:48.373898 17287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:48.374147 17287 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [term 1 LEADER]: Becoming Leader. State: Replica: f9c9283a6957415d824c56b6fa8f3dc4, State: Running, Role: LEADER
I20260807 15:19:48.374580 17287 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9c9283a6957415d824c56b6fa8f3dc4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42959 } }
I20260807 15:19:48.375347 17277 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:19:48.376545 17290 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9c9283a6957415d824c56b6fa8f3dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9c9283a6957415d824c56b6fa8f3dc4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42959 } } }
I20260807 15:19:48.376684 17290 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [sys.catalog]: This master's current role is: LEADER
I20260807 15:19:48.377126 17304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:19:48.377789 17288 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9c9283a6957415d824c56b6fa8f3dc4. Latest consensus state: current_term: 1 leader_uuid: "f9c9283a6957415d824c56b6fa8f3dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9c9283a6957415d824c56b6fa8f3dc4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42959 } } }
I20260807 15:19:48.377944 17288 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4 [sys.catalog]: This master's current role is: LEADER
I20260807 15:19:48.380158 17284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:48.363444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55048 (local address 127.15.242.254:42959)
0807 15:19:48.363971 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:48.363994 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:48.364041 (+ 47us) server_negotiation.cc:407] Connection header received
0807 15:19:48.365012 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:48.365041 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:48.365504 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:48.365883 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:48.366814 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.367961 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.368999 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.370287 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.370495 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:48.373870 (+ 3375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:48.373878 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:48.373900 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:48.373941 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:48.376196 (+ 2255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:48.376802 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:48.376810 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:48.376816 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:48.376998 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:48.377366 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:48.377369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:48.377371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:48.377894 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:48.378109 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:48.378909 (+ 800us) server_negotiation.cc:299] Negotiation successful
0807 15:19:48.379211 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":134,"threads_started":1}
I20260807 15:19:48.380877 17304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:19:48.386335 17304 catalog_manager.cc:1347] Generated new cluster ID: 3402aaddeadf42b6a077d4430e573a0a
I20260807 15:19:48.386402 17304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:19:48.399737 17304 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:19:48.400660 17304 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:19:48.406030 17304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9c9283a6957415d824c56b6fa8f3dc4: Generated new TSK 0
I20260807 15:19:48.406708 17304 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:19:48.444587 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:42959
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:34567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:48.571782 17323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:48.572044 17323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:48.572095 17323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:48.576161 17323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:48.576222 17323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:48.576320 17323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:19:48.581871 17323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:34567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:42959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:48.583005 17323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:48.584055 17323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:48.594168 17335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:48.594229 17333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:48.594168 17332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:48.594712 17323 server_base.cc:1034] running on GCE node
I20260807 15:19:48.595186 17323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:48.595849 17323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:48.597018 17323 hybrid_clock.cc:648] HybridClock initialized: now 1786115988596988 us; error 44 us; skew 500 ppm
Aug 07 15:19:48 dist-test-slave-g170 krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115988, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:48.600051 17323 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:19:48.601049 17323 webserver.cc:460] Webserver started at http://127.15.242.193:45619/ using document root <none> and password file <none>
I20260807 15:19:48.601709 17323 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:48.601831 17323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:48.602087 17323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:48.604279 17323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "228af28cb00441d28d25b1e4b45734ff"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "87bdf9a6082ad4e5390e1e025c079343"
server_key_iv: "e93723b0b5c69fc7bf04f90cfa7473ca"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.604967 17323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "228af28cb00441d28d25b1e4b45734ff"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "87bdf9a6082ad4e5390e1e025c079343"
server_key_iv: "e93723b0b5c69fc7bf04f90cfa7473ca"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.609103 17323 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:19:48.611876 17346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:48.613269 17323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:48.613410 17323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "228af28cb00441d28d25b1e4b45734ff"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "87bdf9a6082ad4e5390e1e025c079343"
server_key_iv: "e93723b0b5c69fc7bf04f90cfa7473ca"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.613523 17323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:48.628343 17323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:48.631556 17323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:48.631793 17323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:48.632493 17323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:19:48.633457 17323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:48.633534 17323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:48.633625 17323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:48.633679 17323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:48.644454 17323 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:36379
I20260807 15:19:48.644511 17522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:36379 every 8 connection(s)
I20260807 15:19:48.645459 17323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:19:48.652686 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17323
I20260807 15:19:48.652889 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:19:48.653198 16331 external_mini_cluster.cc:1428] Setting key ad97d38c2200fecf13243428762db969
Aug 07 15:19:48 dist-test-slave-g170 krb5kdc[17145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115988, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:48.659860 17284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:48.647245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:49595 (local address 127.15.242.254:42959)
0807 15:19:48.647418 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:48.647423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:48.648314 (+ 891us) server_negotiation.cc:407] Connection header received
0807 15:19:48.649280 (+ 966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:48.649283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:48.649332 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:48.649407 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:48.650608 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.651141 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.652252 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.652487 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.652570 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:48.655514 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:48.655517 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:48.655519 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:48.655545 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:48.657415 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:48.657944 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:48.657949 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:48.657952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:48.658062 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:48.658490 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:48.658496 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:48.658501 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:48.658775 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:48.658888 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:48.659437 (+ 549us) server_negotiation.cc:299] Negotiation successful
0807 15:19:48.659601 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 15:19:48.660523 17525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:48.647620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:42959 (local address 127.15.242.193:49595)
0807 15:19:48.648145 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:48.648187 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:48.649064 (+ 877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:48.649573 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:48.649579 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:48.649922 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:48.650456 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:48.650469 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.651278 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.651281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:48.652132 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:48.652141 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.652653 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.652657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:48.652900 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:48.653549 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:48.653571 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:48.655328 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:48.657532 (+ 2204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:48.657537 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:48.657549 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:48.657832 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:48.658196 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:48.658199 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:48.658201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:48.658376 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:48.658902 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:48.658908 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:48.659175 (+ 267us) client_negotiation.cc:769] Sending connection context
0807 15:19:48.659350 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 15:19:48.659620 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":116,"threads_started":1}
I20260807 15:19:48.661916 17523 heartbeater.cc:347] Connected to a master server at 127.15.242.254:42959
I20260807 15:19:48.662212 17523 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:48.662844 17523 heartbeater.cc:511] Master 127.15.242.254:42959 requested a full tablet report, sending...
I20260807 15:19:48.664537 17220 ts_manager.cc:194] Registered new tserver with Master: 228af28cb00441d28d25b1e4b45734ff (127.15.242.193:36379)
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:19:48.665971 17220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:49595
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:19:48.685194 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:42959
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:34567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:48.807368 17528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:48.807689 17528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:48.807778 17528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:48.812165 17528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:48.812264 17528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:48.812371 17528 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:19:48.818074 17528 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:34567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:42959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17528
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:48.819229 17528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:48.820426 17528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:19:48.831064 17528 server_base.cc:1034] running on GCE node
W20260807 15:19:48.831035 17538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:48.831019 17535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:48.831019 17536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:48.831843 17528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:48.832556 17528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:48.833766 17528 hybrid_clock.cc:648] HybridClock initialized: now 1786115988833744 us; error 44 us; skew 500 ppm
Aug 07 15:19:48 dist-test-slave-g170 krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115988, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:48.836830 17528 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:19:48.837805 17528 webserver.cc:460] Webserver started at http://127.15.242.194:42191/ using document root <none> and password file <none>
I20260807 15:19:48.838444 17528 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:48.838546 17528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:48.838790 17528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:48.841063 17528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "29513caf6a214c27929e1fbfd11de003"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "83d1a80aed23d120f9e716645a9c8c83"
server_key_iv: "17ba4269b9434956d2751f8d97ad6d79"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.841692 17528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "29513caf6a214c27929e1fbfd11de003"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "83d1a80aed23d120f9e716645a9c8c83"
server_key_iv: "17ba4269b9434956d2751f8d97ad6d79"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.846052 17528 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:19:48.849190 17548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:48.850641 17528 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:19:48.850843 17528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "29513caf6a214c27929e1fbfd11de003"
format_stamp: "Formatted at 2026-08-07 15:19:48 on dist-test-slave-g170"
server_key: "83d1a80aed23d120f9e716645a9c8c83"
server_key_iv: "17ba4269b9434956d2751f8d97ad6d79"
server_key_version: "encryptionkey@0"
I20260807 15:19:48.850947 17528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:48.867740 17528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:48.871510 17528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:48.871695 17528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:48.872308 17528 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:19:48.873255 17528 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:48.873304 17528 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:48.873346 17528 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:48.873363 17528 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:48.884202 17528 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:42053
I20260807 15:19:48.884230 17715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:42053 every 8 connection(s)
I20260807 15:19:48.885257 17528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:19:48.893199 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17528
I20260807 15:19:48.893333 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:19:48.893632 16331 external_mini_cluster.cc:1428] Setting key a9fb8220c709fb0ad3cd3c4e70b6a6a9
Aug 07 15:19:48 dist-test-slave-g170 krb5kdc[17145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115988, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:48.900818 17284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:48.887195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:33149 (local address 127.15.242.254:42959)
0807 15:19:48.887340 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:48.887344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:48.888185 (+ 841us) server_negotiation.cc:407] Connection header received
0807 15:19:48.889191 (+ 1006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:48.889195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:48.889258 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:48.889371 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:48.890602 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.891134 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.892389 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.892706 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.892896 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:48.896458 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:48.896462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:48.896464 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:48.896491 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:48.898239 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:48.899072 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:48.899079 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:48.899081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:48.899176 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:48.899579 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:48.899583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:48.899585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:48.899812 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:48.899934 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:48.900488 (+ 554us) server_negotiation.cc:299] Negotiation successful
0807 15:19:48.900621 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:19:48.901695 17720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:48.887535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:42959 (local address 127.15.242.194:33149)
0807 15:19:48.888022 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:48.888067 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:48.888962 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:48.889551 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:48.889559 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:48.889951 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:48.890448 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:48.890461 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.891278 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.891281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:48.892181 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:48.892190 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:48.892952 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:48.892956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:48.893171 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:48.894528 (+ 1357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:48.894545 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:48.896241 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:48.898412 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:48.898419 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:48.898438 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:48.898838 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:48.899299 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:48.899302 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:48.899304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:48.899469 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:48.899936 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:48.899944 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:48.900225 (+ 281us) client_negotiation.cc:769] Sending connection context
0807 15:19:48.900442 (+ 217us) client_negotiation.cc:240] Negotiation successful
0807 15:19:48.900817 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":126,"threads_started":1}
I20260807 15:19:48.903228 17717 heartbeater.cc:347] Connected to a master server at 127.15.242.254:42959
I20260807 15:19:48.903540 17717 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:48.904171 17717 heartbeater.cc:511] Master 127.15.242.254:42959 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:19:48.905582 17220 ts_manager.cc:194] Registered new tserver with Master: 29513caf6a214c27929e1fbfd11de003 (127.15.242.194:42053)
I20260807 15:19:48.906280 17220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:33149
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:19:48.926321 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:42959
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:34567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:49.048578 17725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:49.048900 17725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:49.048949 17725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:49.053153 17725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:49.053220 17725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:49.053315 17725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:19:49.058969 17725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:34567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:42959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:49.060148 17725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:49.061247 17725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:49.071507 17736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:49.071465 17740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:49.071473 17735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:49.071893 17725 server_base.cc:1034] running on GCE node
I20260807 15:19:49.072347 17725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:49.073207 17725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:49.074407 17725 hybrid_clock.cc:648] HybridClock initialized: now 1786115989074391 us; error 27 us; skew 500 ppm
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115989, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:49.084846 17725 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:19:49.085994 17725 webserver.cc:460] Webserver started at http://127.15.242.195:39401/ using document root <none> and password file <none>
I20260807 15:19:49.086670 17725 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:49.086751 17725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:49.087025 17725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:49.089416 17725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "8cfeb3ac1437426a86f308da25710c86"
format_stamp: "Formatted at 2026-08-07 15:19:49 on dist-test-slave-g170"
server_key: "89c497b48a0edda2a9233537f021e53d"
server_key_iv: "197ccda954029011773ea142bf0ce0c6"
server_key_version: "encryptionkey@0"
I20260807 15:19:49.090061 17725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "8cfeb3ac1437426a86f308da25710c86"
format_stamp: "Formatted at 2026-08-07 15:19:49 on dist-test-slave-g170"
server_key: "89c497b48a0edda2a9233537f021e53d"
server_key_iv: "197ccda954029011773ea142bf0ce0c6"
server_key_version: "encryptionkey@0"
I20260807 15:19:49.094405 17725 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:19:49.097319 17749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:49.098724 17725 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:49.098830 17725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "8cfeb3ac1437426a86f308da25710c86"
format_stamp: "Formatted at 2026-08-07 15:19:49 on dist-test-slave-g170"
server_key: "89c497b48a0edda2a9233537f021e53d"
server_key_iv: "197ccda954029011773ea142bf0ce0c6"
server_key_version: "encryptionkey@0"
I20260807 15:19:49.098920 17725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:49.122493 17725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:49.126325 17725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:49.126516 17725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:49.127097 17725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:19:49.127945 17725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:49.127995 17725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:49.128036 17725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:49.128051 17725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:49.138255 17725 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:34275
I20260807 15:19:49.138288 17931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:34275 every 8 connection(s)
I20260807 15:19:49.139235 17725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:19:49.145740 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17725
I20260807 15:19:49.145896 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:19:49.146207 16331 external_mini_cluster.cc:1428] Setting key a3eebd9ea024f78883091f1dda0bcf17
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115989, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:49.154394 17284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.141633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:59967 (local address 127.15.242.254:42959)
0807 15:19:49.141816 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.141822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.143006 (+ 1184us) server_negotiation.cc:407] Connection header received
0807 15:19:49.144171 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.144174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.144250 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.144355 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:49.145635 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.146297 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.147807 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.148141 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.148263 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.150840 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:49.150843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:49.150846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:49.150871 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:49.152187 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.152703 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.152706 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.152708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.152857 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.153200 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.153204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.153205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.153397 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:49.153488 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.154091 (+ 603us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.154218 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 15:19:49.155807 17938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.142044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:42959 (local address 127.15.242.195:59967)
0807 15:19:49.142797 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:49.142842 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:49.143916 (+ 1074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:49.144547 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:49.144554 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:49.144962 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:49.145456 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.145492 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.146431 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.146434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.147595 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.147627 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.148294 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.148297 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.148494 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.149152 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:49.149169 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:49.150660 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:49.152297 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:49.152301 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:49.152314 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:49.152569 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:49.152946 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:49.152949 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:49.152950 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:49.153089 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:49.153533 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:49.153539 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:49.153826 (+ 287us) client_negotiation.cc:769] Sending connection context
0807 15:19:49.154033 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 15:19:49.154490 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":138,"threads_started":1}
I20260807 15:19:49.157232 17936 heartbeater.cc:347] Connected to a master server at 127.15.242.254:42959
I20260807 15:19:49.157527 17936 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:49.158094 17936 heartbeater.cc:511] Master 127.15.242.254:42959 requested a full tablet report, sending...
I20260807 15:19:49.159368 17220 ts_manager.cc:194] Registered new tserver with Master: 8cfeb3ac1437426a86f308da25710c86 (127.15.242.195:34275)
I20260807 15:19:49.160084 17220 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:59967
I20260807 15:19:49.160862 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:19:49.172564 17284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.164820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55060 (local address 127.15.242.254:42959)
0807 15:19:49.164953 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.164958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.165153 (+ 195us) server_negotiation.cc:407] Connection header received
0807 15:19:49.165317 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.165320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.165365 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.165457 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:49.166198 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.166715 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.167553 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.167792 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.167899 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.169358 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:49.169362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:49.169365 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:49.169391 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:49.170789 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.171238 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.171242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.171243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.171335 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.171662 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.171666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.171667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.171891 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:49.172038 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.172285 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.172404 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 15:19:49.178092 17219 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:19:49.181521 17219 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:49.197393 17952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.190717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:34275 (local address 127.0.0.1:49020)
0807 15:19:49.191879 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:49.191896 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:49.192001 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:49.192711 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:49.192718 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:49.192745 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:49.192948 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.192958 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.194278 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.194283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.195509 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.195520 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.196739 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.196743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.196887 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.196942 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 15:19:49.197077 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 15:19:49.197210 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1089,"thread_start_us":116,"threads_started":1}
I20260807 15:19:49.197600 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.191129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49020 (local address 127.15.242.195:34275)
0807 15:19:49.192191 (+ 1062us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.192200 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.192219 (+ 19us) server_negotiation.cc:407] Connection header received
0807 15:19:49.192307 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.192312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.192542 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.192696 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:49.193127 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.194139 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.195647 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.196353 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.196500 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.196662 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.197344 (+ 682us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.197453 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":960,"thread_start_us":158,"threads_started":1}
I20260807 15:19:49.198072 17960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.191594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52716 (local address 127.15.242.194:42053)
0807 15:19:49.192069 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.192082 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.193159 (+ 1077us) server_negotiation.cc:407] Connection header received
0807 15:19:49.193279 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.193282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.193465 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.193621 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:49.193850 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.194941 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.196298 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.196973 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.197105 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.197249 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.197484 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.197576 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":133,"threads_started":1}
I20260807 15:19:49.198088 17954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.190688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36379 (local address 127.0.0.1:59316)
0807 15:19:49.191711 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:49.191767 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:49.191900 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:49.193170 (+ 1270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:49.193176 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:49.193199 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:49.193288 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.193295 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.194772 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.194775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.196006 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.196017 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.197344 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.197349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.197451 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.197485 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 15:19:49.197837 (+ 352us) client_negotiation.cc:240] Negotiation successful
0807 15:19:49.197923 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"thread_start_us":108,"threads_started":1}
I20260807 15:19:49.198220 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.191662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59316 (local address 127.15.242.193:36379)
0807 15:19:49.192484 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.192493 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.192519 (+ 26us) server_negotiation.cc:407] Connection header received
0807 15:19:49.192603 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.192606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.192831 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.192985 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:49.193428 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.194637 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.196157 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.197004 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.197144 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.197275 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.197936 (+ 661us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.198035 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":116,"threads_started":1}
I20260807 15:19:49.198508 17951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.191021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:42053 (local address 127.0.0.1:52716)
0807 15:19:49.193048 (+ 2027us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:49.193063 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:49.193153 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:49.193624 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:49.193627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:49.193648 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:49.193741 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.193748 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.195083 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.195087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.196187 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.196194 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.197095 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.197098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.197205 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.197227 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 15:19:49.197323 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 15:19:49.197399 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1951,"thread_start_us":124,"threads_started":1}
I20260807 15:19:49.201035 17826 tablet_service.cc:1467] Processing CreateTablet for tablet f0cc39d64a48491ba6f7aaf9f363fcf3 (DEFAULT_TABLE table=test-table [id=40b34ef5e04f429895b18d42d8bd6e9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:49.201104 17420 tablet_service.cc:1467] Processing CreateTablet for tablet f0cc39d64a48491ba6f7aaf9f363fcf3 (DEFAULT_TABLE table=test-table [id=40b34ef5e04f429895b18d42d8bd6e9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:49.201593 17620 tablet_service.cc:1467] Processing CreateTablet for tablet f0cc39d64a48491ba6f7aaf9f363fcf3 (DEFAULT_TABLE table=test-table [id=40b34ef5e04f429895b18d42d8bd6e9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:49.202165 17420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0cc39d64a48491ba6f7aaf9f363fcf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:49.202172 17826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0cc39d64a48491ba6f7aaf9f363fcf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:49.202551 17620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0cc39d64a48491ba6f7aaf9f363fcf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:49.209307 17962 tablet_bootstrap.cc:492] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86: Bootstrap starting.
I20260807 15:19:49.210095 17964 tablet_bootstrap.cc:492] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff: Bootstrap starting.
I20260807 15:19:49.210714 17967 tablet_bootstrap.cc:492] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003: Bootstrap starting.
I20260807 15:19:49.212193 17964 tablet_bootstrap.cc:654] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:49.213069 17964 log.cc:824] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:49.213068 17962 tablet_bootstrap.cc:654] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:49.213292 17967 tablet_bootstrap.cc:654] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:49.214229 17967 log.cc:824] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:49.214229 17962 log.cc:824] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:49.215476 17964 tablet_bootstrap.cc:492] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff: No bootstrap required, opened a new log
I20260807 15:19:49.215698 17964 ts_tablet_manager.cc:1397] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:19:49.216313 17962 tablet_bootstrap.cc:492] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86: No bootstrap required, opened a new log
I20260807 15:19:49.216308 17967 tablet_bootstrap.cc:492] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003: No bootstrap required, opened a new log
I20260807 15:19:49.216563 17967 ts_tablet_manager.cc:1397] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.006s
I20260807 15:19:49.216563 17962 ts_tablet_manager.cc:1397] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:19:49.219651 17964 raft_consensus.cc:348] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.219944 17964 raft_consensus.cc:374] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:49.220001 17964 raft_consensus.cc:729] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 228af28cb00441d28d25b1e4b45734ff, State: Initialized, Role: FOLLOWER
I20260807 15:19:49.220500 17964 consensus_queue.cc:260] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.220899 17962 raft_consensus.cc:348] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.220888 17967 raft_consensus.cc:348] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.221177 17962 raft_consensus.cc:374] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:49.221177 17967 raft_consensus.cc:374] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:49.221235 17967 raft_consensus.cc:729] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29513caf6a214c27929e1fbfd11de003, State: Initialized, Role: FOLLOWER
I20260807 15:19:49.221244 17962 raft_consensus.cc:729] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cfeb3ac1437426a86f308da25710c86, State: Initialized, Role: FOLLOWER
I20260807 15:19:49.221626 17964 ts_tablet_manager.cc:1428] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:19:49.221731 17962 consensus_queue.cc:260] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.221731 17967 consensus_queue.cc:260] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.222024 17523 heartbeater.cc:503] Master 127.15.242.254:42959 was elected leader, sending a full tablet report...
I20260807 15:19:49.222438 17936 heartbeater.cc:503] Master 127.15.242.254:42959 was elected leader, sending a full tablet report...
I20260807 15:19:49.222743 17962 ts_tablet_manager.cc:1428] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260807 15:19:49.222743 17967 ts_tablet_manager.cc:1428] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 15:19:49.223088 17717 heartbeater.cc:503] Master 127.15.242.254:42959 was elected leader, sending a full tablet report...
I20260807 15:19:49.266312 17974 raft_consensus.cc:482] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:49.266618 17974 raft_consensus.cc:504] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.268389 17974 leader_election.cc:288] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 228af28cb00441d28d25b1e4b45734ff (127.15.242.193:36379), 8cfeb3ac1437426a86f308da25710c86 (127.15.242.195:34275)
I20260807 15:19:49.272958 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.268952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:38749 (local address 127.15.242.193:36379)
0807 15:19:49.269081 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.269087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.269106 (+ 19us) server_negotiation.cc:407] Connection header received
0807 15:19:49.269165 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.269168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.269224 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.269315 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:49.269709 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.270345 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.271751 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.272254 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.272358 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.272403 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.272689 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.272804 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 15:19:49.273025 17720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.268624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36379 (local address 127.15.242.194:38749)
0807 15:19:49.268927 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:49.268944 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:49.269043 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:49.269386 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:49.269390 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:49.269415 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:49.269584 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.269592 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.270477 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.270481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.271603 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.271615 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.272393 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.272397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.272527 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.272571 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 15:19:49.272657 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 15:19:49.272875 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":43}
I20260807 15:19:49.273212 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.268667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:34275 (local address 127.15.242.194:32997)
0807 15:19:49.269193 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:49.269207 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:49.269317 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:49.269707 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:49.269710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:49.269730 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:49.269911 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.269927 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.270880 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.270883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.271834 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:49.271844 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.272659 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.272665 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:49.272870 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.272895 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 15:19:49.272986 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 15:19:49.273063 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":123,"thread_start_us":174,"threads_started":1}
I20260807 15:19:49.273274 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.269116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:32997 (local address 127.15.242.195:34275)
0807 15:19:49.269262 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.269265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.269307 (+ 42us) server_negotiation.cc:407] Connection header received
0807 15:19:49.269436 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.269440 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.269490 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.269578 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:49.270055 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.270748 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.271965 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.272508 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.272653 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.272707 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.273022 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.273113 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 15:19:49.273803 17448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0cc39d64a48491ba6f7aaf9f363fcf3" candidate_uuid: "29513caf6a214c27929e1fbfd11de003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "228af28cb00441d28d25b1e4b45734ff" is_pre_election: true
I20260807 15:19:49.273846 17861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0cc39d64a48491ba6f7aaf9f363fcf3" candidate_uuid: "29513caf6a214c27929e1fbfd11de003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfeb3ac1437426a86f308da25710c86" is_pre_election: true
I20260807 15:19:49.274184 17448 raft_consensus.cc:2454] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29513caf6a214c27929e1fbfd11de003 in term 0.
I20260807 15:19:49.274184 17861 raft_consensus.cc:2454] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29513caf6a214c27929e1fbfd11de003 in term 0.
I20260807 15:19:49.274802 17552 leader_election.cc:302] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 228af28cb00441d28d25b1e4b45734ff, 29513caf6a214c27929e1fbfd11de003, 8cfeb3ac1437426a86f308da25710c86; no voters:
I20260807 15:19:49.275141 17974 raft_consensus.cc:2781] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:49.275279 17974 raft_consensus.cc:482] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:49.275358 17974 raft_consensus.cc:3037] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:49.276719 17974 raft_consensus.cc:504] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.277175 17974 leader_election.cc:288] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [CANDIDATE]: Term 1 election: Requested vote from peers 228af28cb00441d28d25b1e4b45734ff (127.15.242.193:36379), 8cfeb3ac1437426a86f308da25710c86 (127.15.242.195:34275)
I20260807 15:19:49.277601 17448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0cc39d64a48491ba6f7aaf9f363fcf3" candidate_uuid: "29513caf6a214c27929e1fbfd11de003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "228af28cb00441d28d25b1e4b45734ff"
I20260807 15:19:49.277796 17861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0cc39d64a48491ba6f7aaf9f363fcf3" candidate_uuid: "29513caf6a214c27929e1fbfd11de003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfeb3ac1437426a86f308da25710c86"
I20260807 15:19:49.277812 17448 raft_consensus.cc:3037] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:49.277935 17861 raft_consensus.cc:3037] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:49.279500 17861 raft_consensus.cc:2454] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29513caf6a214c27929e1fbfd11de003 in term 1.
I20260807 15:19:49.279500 17448 raft_consensus.cc:2454] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 228af28cb00441d28d25b1e4b45734ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29513caf6a214c27929e1fbfd11de003 in term 1.
I20260807 15:19:49.279965 17550 leader_election.cc:302] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 228af28cb00441d28d25b1e4b45734ff, 29513caf6a214c27929e1fbfd11de003; no voters:
I20260807 15:19:49.280192 17974 raft_consensus.cc:2781] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:49.280850 17974 raft_consensus.cc:686] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [term 1 LEADER]: Becoming Leader. State: Replica: 29513caf6a214c27929e1fbfd11de003, State: Running, Role: LEADER
I20260807 15:19:49.281260 17974 consensus_queue.cc:237] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } }
I20260807 15:19:49.284989 17220 catalog_manager.cc:5495] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29513caf6a214c27929e1fbfd11de003 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "29513caf6a214c27929e1fbfd11de003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "228af28cb00441d28d25b1e4b45734ff" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cfeb3ac1437426a86f308da25710c86" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 34275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29513caf6a214c27929e1fbfd11de003" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42053 } health_report { overall_health: HEALTHY } } }
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:19:49.300642 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.290538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59332 (local address 127.15.242.193:36379)
0807 15:19:49.290710 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.290714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.290826 (+ 112us) server_negotiation.cc:407] Connection header received
0807 15:19:49.290953 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.290955 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.290998 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.291071 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:49.291867 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.292605 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.293680 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.293893 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.293982 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.296632 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:49.296646 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:49.296667 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:49.296699 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:49.298692 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.299216 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.299221 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.299223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.299309 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.299584 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.299586 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.299587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.299886 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:49.300058 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.300270 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.300388 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115989, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115989, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:19:49.333953 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.323783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59342 (local address 127.15.242.193:36379)
0807 15:19:49.323959 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.323964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.325200 (+ 1236us) server_negotiation.cc:407] Connection header received
0807 15:19:49.325598 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.325601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.325652 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.325745 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:49.326538 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.327091 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.327943 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.328183 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.328299 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.330780 (+ 2481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:49.330784 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:49.330786 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:49.330839 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:49.332100 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.332538 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.332548 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.332550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.332630 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.332987 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.332990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.332992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.333171 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:49.333316 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.333636 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.333770 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:19:49.363981 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:49.354339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59350 (local address 127.15.242.193:36379)
0807 15:19:49.354483 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:49.354488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:49.354677 (+ 189us) server_negotiation.cc:407] Connection header received
0807 15:19:49.354878 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:49.354883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:49.354943 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:49.355060 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:49.355972 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.356468 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.357719 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:49.357967 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:49.358054 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:49.360655 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:49.360658 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:49.360660 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:49.360689 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:49.362266 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.362711 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.362715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.362717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.362815 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:49.363100 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:49.363104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:49.363105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:49.363284 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:49.363423 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:49.363675 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 15:19:49.363813 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 15:19:49.365415 17389 tablet_service.cc:2908] Rejecting scan request for tablet f0cc39d64a48491ba6f7aaf9f363fcf3: Uninitialized: clean time has not yet been initialized
I20260807 15:19:49.367712 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17323
W20260807 15:19:49.386538 17718 tablet.cc:2369] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 29513caf6a214c27929e1fbfd11de003: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:19:49.387120 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17528
W20260807 15:19:49.391671 17937 tablet.cc:2369] T f0cc39d64a48491ba6f7aaf9f363fcf3 P 8cfeb3ac1437426a86f308da25710c86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:19:49.400023 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17725
I20260807 15:19:49.420547 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17176
2026-08-07T15:19:49Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2742 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17995](info): set up 2 sockets
Aug 07 15:19:49 dist-test-slave-g170 krb5kdc[17995](info): commencing operation
krb5kdc: starting...
W20260807 15:19:50.794664 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.343s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:19:50 dist-test-slave-g170 krb5kdc[17995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:19:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:19:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:19:50.936570 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45705
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:45705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:51.057847 18011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:51.058144 18011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:51.058216 18011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:51.062480 18011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:19:51.062557 18011 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 15:19:51.062584 18011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:51.062606 18011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:51.062652 18011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:19:51.062691 18011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:19:51.068280 18011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:45705
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:51.069448 18011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:51.070552 18011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:51.079921 18018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:51.079911 18021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:51.079911 18019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:51.080318 18011 server_base.cc:1034] running on GCE node
I20260807 15:19:51.081140 18011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:51.082392 18011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:51.083606 18011 hybrid_clock.cc:648] HybridClock initialized: now 1786115991083568 us; error 57 us; skew 500 ppm
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:51.087316 18011 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:19:51.088370 18011 webserver.cc:460] Webserver started at http://127.15.242.254:42987/ using document root <none> and password file <none>
I20260807 15:19:51.089092 18011 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:51.089169 18011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:51.089370 18011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:51.091665 18011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "bf0c3c6b959e426490664fe9ec812fc5"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "5fcb0ad2332eb86de490d29017fa926d"
server_key_iv: "d54c8373c921decfef1b10ed328c2472"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.092262 18011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "bf0c3c6b959e426490664fe9ec812fc5"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "5fcb0ad2332eb86de490d29017fa926d"
server_key_iv: "d54c8373c921decfef1b10ed328c2472"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.096608 18011 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260807 15:19:51.100162 18029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:51.101619 18011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:51.101943 18011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "bf0c3c6b959e426490664fe9ec812fc5"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "5fcb0ad2332eb86de490d29017fa926d"
server_key_iv: "d54c8373c921decfef1b10ed328c2472"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.102138 18011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:51.116107 18011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:51.119522 18011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:51.119715 18011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:51.129108 18011 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:45705
I20260807 15:19:51.129142 18119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:45705 every 8 connection(s)
I20260807 15:19:51.130151 18011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:19:51.133076 18120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:51.135005 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18011
I20260807 15:19:51.135097 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:19:51.135419 16331 external_mini_cluster.cc:1428] Setting key 75e120f819049247cebaf8ba3dd0b847
I20260807 15:19:51.139227 18120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5: Bootstrap starting.
I20260807 15:19:51.141536 18120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:51.142331 18120 log.cc:824] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:51.144438 18120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5: No bootstrap required, opened a new log
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:51.148530 18120 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c3c6b959e426490664fe9ec812fc5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45705 } }
I20260807 15:19:51.148811 18120 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:51.148890 18120 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf0c3c6b959e426490664fe9ec812fc5, State: Initialized, Role: FOLLOWER
I20260807 15:19:51.149358 18120 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c3c6b959e426490664fe9ec812fc5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45705 } }
I20260807 15:19:51.149489 18120 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:19:51.149575 18120 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:19:51.149710 18120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:51.150679 18120 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c3c6b959e426490664fe9ec812fc5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45705 } }
I20260807 15:19:51.151057 18120 leader_election.cc:302] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf0c3c6b959e426490664fe9ec812fc5; no voters:
I20260807 15:19:51.151409 18120 leader_election.cc:288] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:19:51.151540 18130 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:51.151852 18130 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [term 1 LEADER]: Becoming Leader. State: Replica: bf0c3c6b959e426490664fe9ec812fc5, State: Running, Role: LEADER
I20260807 15:19:51.152149 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.136933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58796 (local address 127.15.242.254:45705)
0807 15:19:51.137434 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:51.137452 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:51.137491 (+ 39us) server_negotiation.cc:407] Connection header received
0807 15:19:51.138437 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:51.138461 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:51.138842 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:51.139254 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:51.140151 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.141382 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.142433 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.143021 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.143223 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.146440 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:51.146446 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:51.146463 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:51.146495 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:51.148416 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.149086 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.149092 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.149097 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.149286 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.149671 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.149674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.149676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.150178 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:51.150440 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:51.150795 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 15:19:51.151112 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":142,"threads_started":1}
I20260807 15:19:51.152304 18130 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c3c6b959e426490664fe9ec812fc5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45705 } }
I20260807 15:19:51.152747 18120 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:19:51.153640 18130 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf0c3c6b959e426490664fe9ec812fc5. Latest consensus state: current_term: 1 leader_uuid: "bf0c3c6b959e426490664fe9ec812fc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c3c6b959e426490664fe9ec812fc5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45705 } } }
I20260807 15:19:51.153873 18130 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [sys.catalog]: This master's current role is: LEADER
I20260807 15:19:51.154587 18149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:19:51.155575 18131 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf0c3c6b959e426490664fe9ec812fc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf0c3c6b959e426490664fe9ec812fc5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45705 } } }
I20260807 15:19:51.155668 18131 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5 [sys.catalog]: This master's current role is: LEADER
I20260807 15:19:51.158098 18149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:19:51.164238 18149 catalog_manager.cc:1347] Generated new cluster ID: 97e3f9de82cd4e5c843d43b69bfba941
I20260807 15:19:51.164388 18149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:19:51.171579 18149 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:19:51.172556 18149 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:19:51.179085 18149 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5: Generated new TSK 0
I20260807 15:19:51.179795 18149 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:19:51.223770 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45705
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:51.363335 18167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:51.363602 18167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:51.363659 18167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:51.368047 18167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:51.368119 18167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:51.368160 18167 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:19:51.368234 18167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:19:51.374428 18167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:45705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:51.375556 18167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:51.376689 18167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:51.386981 18177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:51.387027 18181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:51.387043 18179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:51.387224 18167 server_base.cc:1034] running on GCE node
I20260807 15:19:51.387656 18167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:51.388356 18167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:51.389597 18167 hybrid_clock.cc:648] HybridClock initialized: now 1786115991389560 us; error 40 us; skew 500 ppm
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:51.392647 18167 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:19:51.393714 18167 webserver.cc:460] Webserver started at http://127.15.242.193:33163/ using document root <none> and password file <none>
I20260807 15:19:51.394374 18167 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:51.394479 18167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:51.394748 18167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:51.397169 18167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "35a2edf71a194840b885f8d8d3385813"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "3ef4ec53df6649c1bf17282d1fd634e8"
server_key_iv: "f88a1b0c9118584d836fd855da76b37f"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.397830 18167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "35a2edf71a194840b885f8d8d3385813"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "3ef4ec53df6649c1bf17282d1fd634e8"
server_key_iv: "f88a1b0c9118584d836fd855da76b37f"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.402279 18167 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:19:51.405072 18194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:51.406538 18167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:51.406692 18167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "35a2edf71a194840b885f8d8d3385813"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "3ef4ec53df6649c1bf17282d1fd634e8"
server_key_iv: "f88a1b0c9118584d836fd855da76b37f"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.406826 18167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:51.447798 18167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:51.452235 18167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:51.452466 18167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:51.454378 18167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:51.454433 18167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:51.454495 18167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:51.454528 18167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:51.466477 18167 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:46073
I20260807 15:19:51.466586 18372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:46073 every 8 connection(s)
I20260807 15:19:51.467613 18167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:19:51.469307 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.455353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:58259 (local address 127.15.242.254:45705)
0807 15:19:51.455484 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:51.455489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:51.456674 (+ 1185us) server_negotiation.cc:407] Connection header received
0807 15:19:51.457882 (+ 1208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:51.457886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:51.457960 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:51.458067 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:51.459765 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.460606 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.461841 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.462106 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.462230 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.465188 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:51.465193 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:51.465195 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:51.465227 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:51.467001 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.467518 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.467524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.467529 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.467639 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.468084 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.468089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.468091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.468348 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:51.468459 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:51.469076 (+ 617us) server_negotiation.cc:299] Negotiation successful
0807 15:19:51.469186 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 15:19:51.470135 18203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.455963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45705 (local address 127.15.242.193:58259)
0807 15:19:51.456508 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:51.456553 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:51.457612 (+ 1059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:51.458343 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:51.458353 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:51.458875 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:51.459597 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.459619 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.460783 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.460788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.461706 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.461717 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.462290 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.462294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.462490 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.463149 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:51.463174 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:51.464994 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:51.467116 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.467121 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.467133 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.467389 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.467769 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.467772 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.467775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.467932 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.468462 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:51.468469 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:51.468811 (+ 342us) client_negotiation.cc:769] Sending connection context
0807 15:19:51.468984 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 15:19:51.469237 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":158,"threads_started":1}
I20260807 15:19:51.471452 18373 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45705
I20260807 15:19:51.471625 18373 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:51.472169 18373 heartbeater.cc:511] Master 127.15.242.254:45705 requested a full tablet report, sending...
I20260807 15:19:51.473295 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18167
I20260807 15:19:51.473423 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:19:51.473778 16331 external_mini_cluster.cc:1428] Setting key 14dec679f54c63eb953d020735fc1ec2
I20260807 15:19:51.473904 18052 ts_manager.cc:194] Registered new tserver with Master: 35a2edf71a194840b885f8d8d3385813 (127.15.242.193:46073)
I20260807 15:19:51.475541 18052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:58259
I20260807 15:19:51.482741 18380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.473876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45705 (local address 127.15.242.193:43457)
0807 15:19:51.474351 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:51.474370 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:51.474461 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:51.474875 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:51.474880 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:51.475164 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:51.475337 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.475346 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.476415 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.476420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.477344 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.477360 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.477827 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.477834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.477965 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.478527 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:51.478548 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:51.478996 (+ 448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:51.481207 (+ 2211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.481210 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.481212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.481404 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.481751 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.481754 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.481755 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.481835 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.482315 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:51.482317 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:51.482395 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 15:19:51.482475 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 15:19:51.482580 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":118,"threads_started":1}
I20260807 15:19:51.482913 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.474487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:43457 (local address 127.15.242.254:45705)
0807 15:19:51.474611 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:51.474615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:51.474630 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:19:51.474664 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:51.474667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:51.474708 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:51.474792 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:51.475475 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.476196 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.477484 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.477704 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.477792 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.479163 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:51.479169 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:51.479173 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:51.479206 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:51.481089 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.481514 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.481520 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.481525 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.481632 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.481935 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.481941 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.481946 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.482197 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:51.482311 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:51.482568 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 15:19:51.482702 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":60}
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:19:51.509403 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45705
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:51.627820 18385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:51.628069 18385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:51.628113 18385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:51.632157 18385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:51.632215 18385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:51.632253 18385 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:19:51.632329 18385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:19:51.637594 18385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:45705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:51.638635 18385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:51.639669 18385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:51.649700 18400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:51.649718 18402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:51.649739 18398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:51.650049 18385 server_base.cc:1034] running on GCE node
I20260807 15:19:51.650504 18385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:51.651185 18385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:51.652362 18385 hybrid_clock.cc:648] HybridClock initialized: now 1786115991652346 us; error 35 us; skew 500 ppm
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:51.655364 18385 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:19:51.656296 18385 webserver.cc:460] Webserver started at http://127.15.242.194:35421/ using document root <none> and password file <none>
I20260807 15:19:51.656948 18385 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:51.657042 18385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:51.657285 18385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:51.659382 18385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "70c71972501944eb8db59692d68357e4"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "551b942e9a535490806ade3a04bc5dc5"
server_key_iv: "b1883f76e372f0d8719f3b2f9540b83e"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.659965 18385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "70c71972501944eb8db59692d68357e4"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "551b942e9a535490806ade3a04bc5dc5"
server_key_iv: "b1883f76e372f0d8719f3b2f9540b83e"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.663782 18385 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 15:19:51.666507 18413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:51.667876 18385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:19:51.668047 18385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "70c71972501944eb8db59692d68357e4"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "551b942e9a535490806ade3a04bc5dc5"
server_key_iv: "b1883f76e372f0d8719f3b2f9540b83e"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.668170 18385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:51.695297 18385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:51.698815 18385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:51.699039 18385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:51.700711 18385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:51.700809 18385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:51.700888 18385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:51.700932 18385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:51.712539 18385 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:34903
I20260807 15:19:51.712947 18595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:34903 every 8 connection(s)
I20260807 15:19:51.713589 18385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:19:51.715723 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.701828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:42063 (local address 127.15.242.254:45705)
0807 15:19:51.701991 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:51.701997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:51.702889 (+ 892us) server_negotiation.cc:407] Connection header received
0807 15:19:51.704099 (+ 1210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:51.704107 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:51.704191 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:51.704301 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:51.705787 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.706691 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.708105 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.708468 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.708594 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.711592 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:51.711597 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:51.711600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:51.711636 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:51.713440 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.714027 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.714032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.714033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.714135 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.714607 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.714610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.714612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.714827 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:51.714918 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:51.715439 (+ 521us) server_negotiation.cc:299] Negotiation successful
0807 15:19:51.715547 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:19:51.716424 18428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.702211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45705 (local address 127.15.242.194:42063)
0807 15:19:51.702712 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:51.702765 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:51.703797 (+ 1032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:51.704560 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:51.704581 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:51.705047 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:51.705642 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.705658 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.706832 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.706837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.707949 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.707961 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.708653 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.708658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.708863 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.709514 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:51.709532 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:51.711367 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:51.713571 (+ 2204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.713579 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.713594 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.713902 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.714265 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.714269 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.714271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.714450 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.714935 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:51.714940 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:51.715159 (+ 219us) client_negotiation.cc:769] Sending connection context
0807 15:19:51.715349 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 15:19:51.715598 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":146,"threads_started":1}
I20260807 15:19:51.717518 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18385
I20260807 15:19:51.717633 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:19:51.717981 16331 external_mini_cluster.cc:1428] Setting key 7f31be04b0797ebaaa40f4102e9677ef
I20260807 15:19:51.718039 18596 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45705
I20260807 15:19:51.718189 18596 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:51.718787 18596 heartbeater.cc:511] Master 127.15.242.254:45705 requested a full tablet report, sending...
I20260807 15:19:51.719879 18053 ts_manager.cc:194] Registered new tserver with Master: 70c71972501944eb8db59692d68357e4 (127.15.242.194:34903)
I20260807 15:19:51.720677 18053 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:42063
I20260807 15:19:51.727972 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.720847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:60827 (local address 127.15.242.254:45705)
0807 15:19:51.720957 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:51.720963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:51.720979 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:19:51.721052 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:51.721058 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:51.721114 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:51.721168 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:51.721930 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.722419 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.723280 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.723496 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.723605 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.724810 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:51.724815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:51.724817 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:51.724842 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:51.726215 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.726641 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.726644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.726646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.726768 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.727075 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.727079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.727081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.727334 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:51.727449 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:51.727728 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 15:19:51.727835 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 15:19:51.727986 18602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.720458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45705 (local address 127.15.242.194:60827)
0807 15:19:51.720840 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:51.720859 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:51.720956 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:51.721343 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:51.721349 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:51.721592 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:51.721765 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.721777 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.722588 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.722591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.723150 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.723158 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.723612 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.723615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.723711 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.724252 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:51.724263 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:51.724558 (+ 295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:51.726335 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.726338 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.726340 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.726535 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.726884 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.726888 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.726889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.726978 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.727439 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:51.727442 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:51.727545 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 15:19:51.727652 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 15:19:51.727800 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":139,"threads_started":1}
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:19:51.748876 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45705
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:33345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:51.866564 18606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:51.866838 18606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:51.866883 18606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:51.870810 18606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:51.870867 18606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:51.870905 18606 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:19:51.870937 18606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:19:51.876482 18606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:45705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:51.877703 18606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:51.878717 18606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:51.888917 18618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:51.889096 18606 server_base.cc:1034] running on GCE node
W20260807 15:19:51.888926 18614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:51.888926 18613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:51.889751 18606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:51.890427 18606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:51.891674 18606 hybrid_clock.cc:648] HybridClock initialized: now 1786115991891632 us; error 55 us; skew 500 ppm
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:51.894888 18606 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:19:51.895907 18606 webserver.cc:460] Webserver started at http://127.15.242.195:45417/ using document root <none> and password file <none>
I20260807 15:19:51.896468 18606 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:51.896535 18606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:51.896751 18606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:51.899888 18606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "2a5af2b2d60b414899dd9d822808ab24"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "20cd687194e23c9161e20a4fc04024e7"
server_key_iv: "68e374c8cfc8ef7b4f9e510023e61918"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.900445 18606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "2a5af2b2d60b414899dd9d822808ab24"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "20cd687194e23c9161e20a4fc04024e7"
server_key_iv: "68e374c8cfc8ef7b4f9e510023e61918"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.904670 18606 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 15:19:51.907646 18628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:51.909130 18606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:51.909240 18606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "2a5af2b2d60b414899dd9d822808ab24"
format_stamp: "Formatted at 2026-08-07 15:19:51 on dist-test-slave-g170"
server_key: "20cd687194e23c9161e20a4fc04024e7"
server_key_iv: "68e374c8cfc8ef7b4f9e510023e61918"
server_key_version: "encryptionkey@0"
I20260807 15:19:51.909337 18606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:51.927403 18606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:51.931428 18606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:51.931599 18606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:51.933218 18606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:51.933277 18606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:51.933321 18606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:51.933337 18606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:51.945765 18606 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:40691
I20260807 15:19:51.945832 18810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:40691 every 8 connection(s)
I20260807 15:19:51.946947 18606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:19:51.949559 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.934093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:33637 (local address 127.15.242.254:45705)
0807 15:19:51.934236 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:51.934240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:51.935429 (+ 1189us) server_negotiation.cc:407] Connection header received
0807 15:19:51.936591 (+ 1162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:51.936598 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:51.936671 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:51.936743 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:51.938543 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.939437 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.941511 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.941919 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.942043 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.945569 (+ 3526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:51.945574 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:51.945577 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:51.945612 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:51.947243 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.947921 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.947924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.947927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.948020 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.948396 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.948400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.948402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.948610 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:51.948722 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:51.949263 (+ 541us) server_negotiation.cc:299] Negotiation successful
0807 15:19:51.949390 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 15:19:51.950323 18641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.934677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45705 (local address 127.15.242.195:33637)
0807 15:19:51.935254 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:51.935305 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:51.936304 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:51.937264 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:51.937272 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:51.937648 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:51.938373 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.938392 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.939662 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.939667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.941342 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.941355 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.942251 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.942255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.942490 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.943301 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:51.943326 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:51.945373 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:51.947385 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.947393 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.947409 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.947789 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.948134 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.948138 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.948140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.948287 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.948731 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:51.948741 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:51.949012 (+ 271us) client_negotiation.cc:769] Sending connection context
0807 15:19:51.949202 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 15:19:51.949516 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":177,"threads_started":1}
I20260807 15:19:51.951563 18811 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45705
I20260807 15:19:51.951710 18811 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:51.952299 18811 heartbeater.cc:511] Master 127.15.242.254:45705 requested a full tablet report, sending...
I20260807 15:19:51.953557 18052 ts_manager.cc:194] Registered new tserver with Master: 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691)
I20260807 15:19:51.954497 18052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:33637
I20260807 15:19:51.956570 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18606
I20260807 15:19:51.956712 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:19:51.957000 16331 external_mini_cluster.cc:1428] Setting key 0ae7425bbec816bb4bc82065ea6a0ecd
I20260807 15:19:51.959380 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:19:51.962199 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.954176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:47021 (local address 127.15.242.254:45705)
0807 15:19:51.954305 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:51.954310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:51.954501 (+ 191us) server_negotiation.cc:407] Connection header received
0807 15:19:51.954649 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:51.954652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:51.954695 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:51.954821 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:51.955249 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.955758 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.956583 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.956919 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.957025 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.958367 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:51.958374 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:51.958377 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:51.958401 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:51.960172 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.960730 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.960733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.960734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.960869 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.961217 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.961220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.961221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.961387 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:51.961465 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:51.961856 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 15:19:51.961996 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 15:19:51.962212 18817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.954077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45705 (local address 127.15.242.195:47021)
0807 15:19:51.954418 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:51.954430 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:51.954541 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:51.954835 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:51.954838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:51.955040 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:51.955135 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.955140 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.955898 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.955902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.956460 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:51.956468 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.957040 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.957043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:51.957146 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.957783 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:51.957800 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:51.958215 (+ 415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:51.960300 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.960307 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.960311 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.960591 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.960974 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:51.960980 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:51.960985 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:51.961110 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:51.961484 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:51.961490 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:51.961610 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 15:19:51.961731 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 15:19:51.961905 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":136,"threads_started":1}
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 15:19:51 dist-test-slave-g170 krb5kdc[17995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:51.990976 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:51.981639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58810 (local address 127.15.242.254:45705)
0807 15:19:51.981823 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:51.981827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:51.981839 (+ 12us) server_negotiation.cc:407] Connection header received
0807 15:19:51.981883 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:51.981885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:51.981924 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:51.982023 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:51.982790 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.983436 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.984660 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:51.984983 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:51.985107 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:51.987719 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:51.987723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:51.987728 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:51.987760 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:51.989203 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.989692 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.989696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.989698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.989787 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:51.990072 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:51.990075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:51.990077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:51.990269 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:51.990425 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:51.990679 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 15:19:51.990803 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260807 15:19:51.994451 18052 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58810:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:19:51.997715 18052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:52.014425 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.008924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44748 (local address 127.15.242.195:40691)
0807 15:19:52.009699 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.009713 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.009735 (+ 22us) server_negotiation.cc:407] Connection header received
0807 15:19:52.009820 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.009824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.009956 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.010110 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:52.010334 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.011353 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.013021 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.013715 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.013887 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.014020 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.014154 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.014256 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":111,"threads_started":1}
I20260807 15:19:52.014412 18837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.007492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:40691 (local address 127.0.0.1:44748)
0807 15:19:52.008117 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.008174 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.008315 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.010099 (+ 1784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.010102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.010121 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:52.010205 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.010212 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.011481 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.011484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.012871 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.012883 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.013850 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.013853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.013966 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.014005 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.014124 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.014256 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":129,"thread_start_us":149,"threads_started":1}
I20260807 15:19:52.014678 18836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.007513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:46073 (local address 127.0.0.1:52832)
0807 15:19:52.008251 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.008263 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.008327 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.009402 (+ 1075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.009410 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.009440 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:52.009594 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.009602 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.011171 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.011176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.012870 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.012883 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.014263 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.014266 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.014334 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.014351 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.014447 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.014525 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":279,"thread_start_us":97,"threads_started":1}
I20260807 15:19:52.015018 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.007610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52832 (local address 127.15.242.193:46073)
0807 15:19:52.008839 (+ 1229us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.008849 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.008877 (+ 28us) server_negotiation.cc:407] Connection header received
0807 15:19:52.008970 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.008976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.009231 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.009374 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:52.009715 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.010984 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.013007 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.013988 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.014111 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.014205 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.014496 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.014881 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":83,"threads_started":1}
I20260807 15:19:52.015271 18839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.008301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:34903 (local address 127.0.0.1:55964)
0807 15:19:52.008544 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.008554 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.008616 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.009530 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.009536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.009559 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:52.009674 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.009680 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.011119 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.011123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.012584 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.012595 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.014805 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.014809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.014934 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.014967 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.015039 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.015125 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":38,"thread_start_us":113,"threads_started":1}
I20260807 15:19:52.015501 18840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.008480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55964 (local address 127.15.242.194:34903)
0807 15:19:52.008973 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.008989 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.009013 (+ 24us) server_negotiation.cc:407] Connection header received
0807 15:19:52.009172 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.009178 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.009365 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.009524 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:52.009784 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.010967 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.012721 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.013704 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.013858 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.014008 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.015266 (+ 1258us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.015363 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":122,"threads_started":1}
I20260807 15:19:52.018062 18268 tablet_service.cc:1467] Processing CreateTablet for tablet 49e97a7941c14fa6bc6126eb124c798c (DEFAULT_TABLE table=test-table [id=9523bd7177014e2cae4f9801a49ba9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:52.018098 18485 tablet_service.cc:1467] Processing CreateTablet for tablet 49e97a7941c14fa6bc6126eb124c798c (DEFAULT_TABLE table=test-table [id=9523bd7177014e2cae4f9801a49ba9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:52.018100 18708 tablet_service.cc:1467] Processing CreateTablet for tablet 49e97a7941c14fa6bc6126eb124c798c (DEFAULT_TABLE table=test-table [id=9523bd7177014e2cae4f9801a49ba9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:52.019250 18268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49e97a7941c14fa6bc6126eb124c798c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.019248 18485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49e97a7941c14fa6bc6126eb124c798c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.019399 18708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49e97a7941c14fa6bc6126eb124c798c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.026700 18843 tablet_bootstrap.cc:492] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: Bootstrap starting.
I20260807 15:19:52.028290 18847 tablet_bootstrap.cc:492] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: Bootstrap starting.
I20260807 15:19:52.028748 18843 tablet_bootstrap.cc:654] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.029115 18845 tablet_bootstrap.cc:492] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: Bootstrap starting.
I20260807 15:19:52.029750 18843 log.cc:824] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:52.030604 18847 tablet_bootstrap.cc:654] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.031302 18845 tablet_bootstrap.cc:654] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.031484 18847 log.cc:824] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:52.032001 18843 tablet_bootstrap.cc:492] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: No bootstrap required, opened a new log
I20260807 15:19:52.032182 18845 log.cc:824] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:52.032238 18843 ts_tablet_manager.cc:1397] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260807 15:19:52.033653 18847 tablet_bootstrap.cc:492] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: No bootstrap required, opened a new log
I20260807 15:19:52.033849 18847 ts_tablet_manager.cc:1397] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:19:52.034284 18845 tablet_bootstrap.cc:492] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: No bootstrap required, opened a new log
I20260807 15:19:52.034469 18845 ts_tablet_manager.cc:1397] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:19:52.036072 18843 raft_consensus.cc:348] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.036329 18843 raft_consensus.cc:374] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.036389 18843 raft_consensus.cc:729] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35a2edf71a194840b885f8d8d3385813, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.036873 18843 consensus_queue.cc:260] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.037853 18843 ts_tablet_manager.cc:1428] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 15:19:52.037981 18847 raft_consensus.cc:348] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.038242 18373 heartbeater.cc:503] Master 127.15.242.254:45705 was elected leader, sending a full tablet report...
I20260807 15:19:52.038262 18847 raft_consensus.cc:374] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.038314 18847 raft_consensus.cc:729] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a5af2b2d60b414899dd9d822808ab24, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.038451 18845 raft_consensus.cc:348] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.038707 18845 raft_consensus.cc:374] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.038765 18845 raft_consensus.cc:729] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c71972501944eb8db59692d68357e4, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.038793 18847 consensus_queue.cc:260] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.039187 18845 consensus_queue.cc:260] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.039625 18811 heartbeater.cc:503] Master 127.15.242.254:45705 was elected leader, sending a full tablet report...
I20260807 15:19:52.039974 18596 heartbeater.cc:503] Master 127.15.242.254:45705 was elected leader, sending a full tablet report...
I20260807 15:19:52.041033 18845 ts_tablet_manager.cc:1428] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:19:52.041986 18847 ts_tablet_manager.cc:1428] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 15:19:52.049414 18855 raft_consensus.cc:482] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:52.049582 18855 raft_consensus.cc:504] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.050657 18855 leader_election.cc:288] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35a2edf71a194840b885f8d8d3385813 (127.15.242.193:46073), 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691)
I20260807 15:19:52.055449 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.051040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:41359 (local address 127.15.242.195:40691)
0807 15:19:52.051179 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.051186 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.051410 (+ 224us) server_negotiation.cc:407] Connection header received
0807 15:19:52.051495 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.051500 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.051549 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.051619 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:52.051931 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.052747 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.054044 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.054693 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.054800 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.054840 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.055193 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.055312 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 15:19:52.055581 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.050958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:40691 (local address 127.15.242.194:41359)
0807 15:19:52.051317 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.051333 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.051427 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.051637 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.051640 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.051652 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:52.051826 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.051835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.052905 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.052908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.053894 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.053904 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.054807 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.054811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.054936 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.054965 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.055241 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.055322 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":22,"thread_start_us":109,"threads_started":1}
I20260807 15:19:52.055995 18428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.050914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:46073 (local address 127.15.242.194:56307)
0807 15:19:52.051109 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.051125 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.051244 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.051562 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.051565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.051580 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:52.051794 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.051805 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.052921 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.052925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.054570 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.054581 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.055556 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.055561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.055699 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.055729 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.055827 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.055882 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":63}
I20260807 15:19:52.056069 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.050964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:56307 (local address 127.15.242.193:46073)
0807 15:19:52.051083 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.051088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.051214 (+ 126us) server_negotiation.cc:407] Connection header received
0807 15:19:52.051384 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.051387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.051445 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.051550 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:52.051931 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.052752 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.054694 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.055332 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.055444 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.055488 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.055847 (+ 359us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.055947 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 15:19:52.056367 18721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49e97a7941c14fa6bc6126eb124c798c" candidate_uuid: "70c71972501944eb8db59692d68357e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5af2b2d60b414899dd9d822808ab24" is_pre_election: true
I20260807 15:19:52.056639 18721 raft_consensus.cc:2454] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c71972501944eb8db59692d68357e4 in term 0.
I20260807 15:19:52.056670 18302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49e97a7941c14fa6bc6126eb124c798c" candidate_uuid: "70c71972501944eb8db59692d68357e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35a2edf71a194840b885f8d8d3385813" is_pre_election: true
I20260807 15:19:52.057011 18302 raft_consensus.cc:2454] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70c71972501944eb8db59692d68357e4 in term 0.
I20260807 15:19:52.057164 18418 leader_election.cc:302] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a5af2b2d60b414899dd9d822808ab24, 70c71972501944eb8db59692d68357e4; no voters:
I20260807 15:19:52.057446 18855 raft_consensus.cc:2781] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:52.057534 18855 raft_consensus.cc:482] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:52.057585 18855 raft_consensus.cc:3037] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.058633 18855 raft_consensus.cc:504] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.059005 18855 leader_election.cc:288] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [CANDIDATE]: Term 1 election: Requested vote from peers 35a2edf71a194840b885f8d8d3385813 (127.15.242.193:46073), 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691)
I20260807 15:19:52.059338 18721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49e97a7941c14fa6bc6126eb124c798c" candidate_uuid: "70c71972501944eb8db59692d68357e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5af2b2d60b414899dd9d822808ab24"
I20260807 15:19:52.059417 18302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49e97a7941c14fa6bc6126eb124c798c" candidate_uuid: "70c71972501944eb8db59692d68357e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35a2edf71a194840b885f8d8d3385813"
I20260807 15:19:52.059459 18721 raft_consensus.cc:3037] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.059525 18302 raft_consensus.cc:3037] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.060809 18302 raft_consensus.cc:2454] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c71972501944eb8db59692d68357e4 in term 1.
I20260807 15:19:52.060809 18721 raft_consensus.cc:2454] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70c71972501944eb8db59692d68357e4 in term 1.
I20260807 15:19:52.061125 18416 leader_election.cc:302] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a2edf71a194840b885f8d8d3385813, 70c71972501944eb8db59692d68357e4; no voters:
I20260807 15:19:52.061317 18855 raft_consensus.cc:2781] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:52.061538 18855 raft_consensus.cc:686] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 1 LEADER]: Becoming Leader. State: Replica: 70c71972501944eb8db59692d68357e4, State: Running, Role: LEADER
I20260807 15:19:52.061926 18855 consensus_queue.cc:237] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } }
I20260807 15:19:52.065306 18050 catalog_manager.cc:5495] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70c71972501944eb8db59692d68357e4 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "70c71972501944eb8db59692d68357e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260807 15:19:52.082342 18840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.078500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55978 (local address 127.15.242.194:34903)
0807 15:19:52.078626 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.078630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.078643 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:19:52.078873 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.078876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.078931 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.079017 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:52.079292 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.079930 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.080905 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.081130 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.081231 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.081573 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:52.081978 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:52.082064 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.082144 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.082211 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:19:52.088827 18302 raft_consensus.cc:1261] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Refusing update from remote peer 70c71972501944eb8db59692d68357e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:52.089084 18721 raft_consensus.cc:1261] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Refusing update from remote peer 70c71972501944eb8db59692d68357e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:52.089632 18860 consensus_queue.cc:1035] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:52.089912 18855 consensus_queue.cc:1035] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:52.097113 18866 mvcc.cc:205] Tried to move back new op lower bound from 7315931103587012608 to 7315931103488651264. Current Snapshot: MvccSnapshot[applied={T|T < 7315931103587012608}]
I20260807 15:19:52.100155 18865 mvcc.cc:205] Tried to move back new op lower bound from 7315931103587012608 to 7315931103488651264. Current Snapshot: MvccSnapshot[applied={T|T < 7315931103587012608 or (T in {7315931103587012608})}]
I20260807 15:19:52.109800 18050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:52.109985 18050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:52.112684 18050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5: Sending DeleteTablet for 3 replicas of tablet 49e97a7941c14fa6bc6126eb124c798c
I20260807 15:19:52.113626 18485 tablet_service.cc:1514] Processing DeleteTablet for tablet 49e97a7941c14fa6bc6126eb124c798c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:52 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:55964
I20260807 15:19:52.113634 18268 tablet_service.cc:1514] Processing DeleteTablet for tablet 49e97a7941c14fa6bc6126eb124c798c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:52 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:52832
I20260807 15:19:52.113683 18708 tablet_service.cc:1514] Processing DeleteTablet for tablet 49e97a7941c14fa6bc6126eb124c798c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:52 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:44748
I20260807 15:19:52.114215 18880 tablet_replica.cc:330] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: stopping tablet replica
I20260807 15:19:52.114579 18880 raft_consensus.cc:2229] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:52.114701 18050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58810:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 15:19:52.114955 18880 raft_consensus.cc:2258] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 15:19:52.115166 18050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:52.115381 18876 tablet_replica.cc:330] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: stopping tablet replica
I20260807 15:19:52.115665 18876 raft_consensus.cc:2229] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:19:52.116078 18876 raft_consensus.cc:2258] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:52.116456 18879 tablet_replica.cc:330] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: stopping tablet replica
I20260807 15:19:52.116900 18879 raft_consensus.cc:2229] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:52.117218 18879 raft_consensus.cc:2258] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:52.117775 18876 ts_tablet_manager.cc:1905] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:52.118757 18879 ts_tablet_manager.cc:1905] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:52.120894 18876 ts_tablet_manager.cc:1918] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:19:52.120898 18268 tablet_service.cc:1467] Processing CreateTablet for tablet 186394e9a79249dab0f2ffc336922201 (DEFAULT_TABLE table=test-table [id=52c6a8dc4cc9467d86f17777a5b46ebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:52.121114 18876 log.cc:1196] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/49e97a7941c14fa6bc6126eb124c798c
I20260807 15:19:52.121209 18268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 186394e9a79249dab0f2ffc336922201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.120972 18485 tablet_service.cc:1467] Processing CreateTablet for tablet 186394e9a79249dab0f2ffc336922201 (DEFAULT_TABLE table=test-table [id=52c6a8dc4cc9467d86f17777a5b46ebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:52.121433 18485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 186394e9a79249dab0f2ffc336922201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.121680 18876 ts_tablet_manager.cc:1939] T 49e97a7941c14fa6bc6126eb124c798c P 70c71972501944eb8db59692d68357e4: Deleting consensus metadata
I20260807 15:19:52.123718 18845 tablet_bootstrap.cc:492] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: Bootstrap starting.
I20260807 15:19:52.124078 18032 catalog_manager.cc:4841] TS 70c71972501944eb8db59692d68357e4 (127.15.242.194:34903): tablet 49e97a7941c14fa6bc6126eb124c798c (table test-table [id=9523bd7177014e2cae4f9801a49ba9b2]) successfully deleted
I20260807 15:19:52.124110 18708 tablet_service.cc:1467] Processing CreateTablet for tablet 186394e9a79249dab0f2ffc336922201 (DEFAULT_TABLE table=test-table [id=52c6a8dc4cc9467d86f17777a5b46ebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:52.124365 18708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 186394e9a79249dab0f2ffc336922201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.124708 18845 tablet_bootstrap.cc:654] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.126585 18879 ts_tablet_manager.cc:1918] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:19:52.126698 18879 log.cc:1196] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/49e97a7941c14fa6bc6126eb124c798c
I20260807 15:19:52.127043 18879 ts_tablet_manager.cc:1939] T 49e97a7941c14fa6bc6126eb124c798c P 2a5af2b2d60b414899dd9d822808ab24: Deleting consensus metadata
I20260807 15:19:52.127069 18847 tablet_bootstrap.cc:492] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: Bootstrap starting.
I20260807 15:19:52.128060 18847 tablet_bootstrap.cc:654] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.129333 18843 tablet_bootstrap.cc:492] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: Bootstrap starting.
I20260807 15:19:52.129356 18847 tablet_bootstrap.cc:492] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: No bootstrap required, opened a new log
I20260807 15:19:52.129434 18847 ts_tablet_manager.cc:1397] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 15:19:52.129879 18847 raft_consensus.cc:348] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.129985 18847 raft_consensus.cc:374] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.130015 18847 raft_consensus.cc:729] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a5af2b2d60b414899dd9d822808ab24, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.130129 18847 consensus_queue.cc:260] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.130304 18843 tablet_bootstrap.cc:654] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.130364 18847 ts_tablet_manager.cc:1428] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:19:52.131822 18843 tablet_bootstrap.cc:492] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: No bootstrap required, opened a new log
I20260807 15:19:52.131903 18843 ts_tablet_manager.cc:1397] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 15:19:52.132332 18843 raft_consensus.cc:348] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.132440 18843 raft_consensus.cc:374] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.132468 18843 raft_consensus.cc:729] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35a2edf71a194840b885f8d8d3385813, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.132575 18843 consensus_queue.cc:260] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.132817 18843 ts_tablet_manager.cc:1428] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:19:52.128916 18032 catalog_manager.cc:4841] TS 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691): tablet 49e97a7941c14fa6bc6126eb124c798c (table test-table [id=9523bd7177014e2cae4f9801a49ba9b2]) successfully deleted
I20260807 15:19:52.137794 18880 ts_tablet_manager.cc:1905] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:52.137853 18845 tablet_bootstrap.cc:492] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: No bootstrap required, opened a new log
I20260807 15:19:52.137946 18845 ts_tablet_manager.cc:1397] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260807 15:19:52.138484 18845 raft_consensus.cc:348] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.138630 18845 raft_consensus.cc:374] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.138669 18845 raft_consensus.cc:729] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c71972501944eb8db59692d68357e4, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.138805 18845 consensus_queue.cc:260] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.139071 18845 ts_tablet_manager.cc:1428] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 15:19:52.141197 18880 ts_tablet_manager.cc:1918] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:19:52.141348 18880 log.cc:1196] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/49e97a7941c14fa6bc6126eb124c798c
I20260807 15:19:52.141680 18880 ts_tablet_manager.cc:1939] T 49e97a7941c14fa6bc6126eb124c798c P 35a2edf71a194840b885f8d8d3385813: Deleting consensus metadata
I20260807 15:19:52.143013 18030 catalog_manager.cc:4841] TS 35a2edf71a194840b885f8d8d3385813 (127.15.242.193:46073): tablet 49e97a7941c14fa6bc6126eb124c798c (table test-table [id=9523bd7177014e2cae4f9801a49ba9b2]) successfully deleted
W20260807 15:19:52.197978 18812 tablet.cc:2369] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:19:52.215451 18597 tablet.cc:2369] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:19:52.219550 18374 tablet.cc:2369] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:19:52.303737 18852 raft_consensus.cc:482] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:52.303927 18852 raft_consensus.cc:504] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.305291 18852 leader_election.cc:288] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c71972501944eb8db59692d68357e4 (127.15.242.194:34903), 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691)
I20260807 15:19:52.310190 18841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.306365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:54799 (local address 127.15.242.195:40691)
0807 15:19:52.306533 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.306538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.306554 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:19:52.306769 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.306772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.306815 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.306904 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:52.307249 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.307895 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.309075 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.309484 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.309680 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.309751 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.309987 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.310062 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 15:19:52.310216 18886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.306147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:40691 (local address 127.15.242.193:54799)
0807 15:19:52.306465 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.306487 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.306625 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.306915 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.306918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.306995 (+ 77us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:52.307124 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.307130 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.308017 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.308022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.308938 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.308949 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.309695 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.309699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.309842 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.309870 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.309954 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.310029 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":1,"thread_start_us":107,"threads_started":1}
I20260807 15:19:52.310220 18840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.305778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:40525 (local address 127.15.242.194:34903)
0807 15:19:52.305959 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.305963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.306166 (+ 203us) server_negotiation.cc:407] Connection header received
0807 15:19:52.306340 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.306344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.306435 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.306495 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:52.306979 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.307569 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.308724 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.309332 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.309686 (+ 354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.309750 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.310015 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.310095 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 15:19:52.310245 18884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.305731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:34903 (local address 127.15.242.193:40525)
0807 15:19:52.305993 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.306009 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.306164 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.306724 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.306730 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.306754 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:52.306862 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.306867 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.307688 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.307693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.308521 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.308532 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.309727 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.309731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.309876 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.309894 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.309993 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.310066 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":29,"thread_start_us":96,"threads_started":1}
I20260807 15:19:52.310949 18721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "186394e9a79249dab0f2ffc336922201" candidate_uuid: "35a2edf71a194840b885f8d8d3385813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5af2b2d60b414899dd9d822808ab24" is_pre_election: true
I20260807 15:19:52.311049 18525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "186394e9a79249dab0f2ffc336922201" candidate_uuid: "35a2edf71a194840b885f8d8d3385813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c71972501944eb8db59692d68357e4" is_pre_election: true
I20260807 15:19:52.311131 18721 raft_consensus.cc:2454] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a2edf71a194840b885f8d8d3385813 in term 0.
I20260807 15:19:52.311347 18525 raft_consensus.cc:2454] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a2edf71a194840b885f8d8d3385813 in term 0.
I20260807 15:19:52.311546 18196 leader_election.cc:302] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a5af2b2d60b414899dd9d822808ab24, 35a2edf71a194840b885f8d8d3385813; no voters:
I20260807 15:19:52.311829 18852 raft_consensus.cc:2781] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:52.311894 18852 raft_consensus.cc:482] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:52.311932 18852 raft_consensus.cc:3037] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.313217 18852 raft_consensus.cc:504] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.313711 18852 leader_election.cc:288] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [CANDIDATE]: Term 1 election: Requested vote from peers 70c71972501944eb8db59692d68357e4 (127.15.242.194:34903), 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691)
I20260807 15:19:52.314121 18721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "186394e9a79249dab0f2ffc336922201" candidate_uuid: "35a2edf71a194840b885f8d8d3385813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5af2b2d60b414899dd9d822808ab24"
I20260807 15:19:52.314116 18525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "186394e9a79249dab0f2ffc336922201" candidate_uuid: "35a2edf71a194840b885f8d8d3385813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c71972501944eb8db59692d68357e4"
I20260807 15:19:52.314252 18525 raft_consensus.cc:3037] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.314251 18721 raft_consensus.cc:3037] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.315212 18721 raft_consensus.cc:2454] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a2edf71a194840b885f8d8d3385813 in term 1.
I20260807 15:19:52.315426 18525 raft_consensus.cc:2454] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a2edf71a194840b885f8d8d3385813 in term 1.
I20260807 15:19:52.315508 18196 leader_election.cc:302] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a5af2b2d60b414899dd9d822808ab24, 35a2edf71a194840b885f8d8d3385813; no voters:
I20260807 15:19:52.315685 18852 raft_consensus.cc:2781] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:52.315922 18852 raft_consensus.cc:686] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 1 LEADER]: Becoming Leader. State: Replica: 35a2edf71a194840b885f8d8d3385813, State: Running, Role: LEADER
I20260807 15:19:52.316196 18852 consensus_queue.cc:237] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.318733 18052 catalog_manager.cc:5495] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35a2edf71a194840b885f8d8d3385813 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
Aug 07 15:19:52 dist-test-slave-g170 krb5kdc[17995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:52.356987 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.346719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45705 (local address 127.0.0.1:58826)
0807 15:19:52.347133 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.347145 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.347288 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.347564 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.347567 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.348134 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:52.348267 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.348274 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.349168 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.349173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.349775 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.349784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.350251 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.350254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.350346 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.350989 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:52.351007 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:52.352651 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:52.355060 (+ 2409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:52.355072 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:52.355081 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:52.355354 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:52.355664 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:52.355669 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:52.355672 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:52.355773 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:52.356204 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:52.356214 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:52.356350 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.356485 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.356695 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":133,"threads_started":1}
I20260807 15:19:52.356987 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.346862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58826 (local address 127.15.242.254:45705)
0807 15:19:52.347047 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.347053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.347226 (+ 173us) server_negotiation.cc:407] Connection header received
0807 15:19:52.347407 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.347414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.347453 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.347538 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:52.348420 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.349039 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.349903 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.350133 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.350245 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.352944 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:52.352947 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:52.352950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:52.352973 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:52.354925 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:52.355467 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:52.355473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:52.355475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:52.355566 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:52.355880 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:52.355883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:52.355885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:52.356089 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:52.356204 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.356548 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.356791 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":91,"server-negotiator.queue_time_us":54}
I20260807 15:19:52.361506 18052 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:58826:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 15:19:52.362206 18052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:52.368111 18485 tablet_service.cc:1467] Processing CreateTablet for tablet 3ced48483c6d463b8b376730cc0ed1a2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3a3f6a2a76964803bff2f51a18835b51]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:19:52.368150 18708 tablet_service.cc:1467] Processing CreateTablet for tablet 3ced48483c6d463b8b376730cc0ed1a2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3a3f6a2a76964803bff2f51a18835b51]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:19:52.368150 18268 tablet_service.cc:1467] Processing CreateTablet for tablet 3ced48483c6d463b8b376730cc0ed1a2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3a3f6a2a76964803bff2f51a18835b51]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:19:52.368602 18268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ced48483c6d463b8b376730cc0ed1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.368602 18708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ced48483c6d463b8b376730cc0ed1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.368605 18485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ced48483c6d463b8b376730cc0ed1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:52.371826 18845 tablet_bootstrap.cc:492] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: Bootstrap starting.
I20260807 15:19:52.371850 18843 tablet_bootstrap.cc:492] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: Bootstrap starting.
I20260807 15:19:52.372895 18845 tablet_bootstrap.cc:654] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.372895 18843 tablet_bootstrap.cc:654] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.372910 18847 tablet_bootstrap.cc:492] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: Bootstrap starting.
I20260807 15:19:52.374059 18847 tablet_bootstrap.cc:654] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:52.374214 18845 tablet_bootstrap.cc:492] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: No bootstrap required, opened a new log
I20260807 15:19:52.374229 18843 tablet_bootstrap.cc:492] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: No bootstrap required, opened a new log
I20260807 15:19:52.374320 18843 ts_tablet_manager.cc:1397] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:52.374320 18845 ts_tablet_manager.cc:1397] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 15:19:52.374760 18843 raft_consensus.cc:348] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.374752 18845 raft_consensus.cc:348] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.374881 18845 raft_consensus.cc:374] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.374881 18843 raft_consensus.cc:374] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.374923 18845 raft_consensus.cc:729] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c71972501944eb8db59692d68357e4, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.374923 18843 raft_consensus.cc:729] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35a2edf71a194840b885f8d8d3385813, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.375051 18843 consensus_queue.cc:260] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.375051 18845 consensus_queue.cc:260] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.375348 18845 ts_tablet_manager.cc:1428] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 15:19:52.375320 18860 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.375452 18860 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:52.375614 18847 tablet_bootstrap.cc:492] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: No bootstrap required, opened a new log
I20260807 15:19:52.375691 18847 ts_tablet_manager.cc:1397] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:52.375751 18843 ts_tablet_manager.cc:1428] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:19:52.375687 18852 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.375828 18852 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:52.376183 18847 raft_consensus.cc:348] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.376304 18847 raft_consensus.cc:374] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:52.376344 18847 raft_consensus.cc:729] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a5af2b2d60b414899dd9d822808ab24, State: Initialized, Role: FOLLOWER
I20260807 15:19:52.376484 18847 consensus_queue.cc:260] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.376813 18847 ts_tablet_manager.cc:1428] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:19:52.376789 18853 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.377002 18853 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:52.617273 18852 raft_consensus.cc:482] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:52.617424 18852 raft_consensus.cc:504] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.617959 18852 leader_election.cc:288] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c71972501944eb8db59692d68357e4 (127.15.242.194:34903), 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691)
I20260807 15:19:52.618551 18525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ced48483c6d463b8b376730cc0ed1a2" candidate_uuid: "35a2edf71a194840b885f8d8d3385813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c71972501944eb8db59692d68357e4" is_pre_election: true
I20260807 15:19:52.618551 18721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ced48483c6d463b8b376730cc0ed1a2" candidate_uuid: "35a2edf71a194840b885f8d8d3385813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5af2b2d60b414899dd9d822808ab24" is_pre_election: true
I20260807 15:19:52.618727 18525 raft_consensus.cc:2454] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a2edf71a194840b885f8d8d3385813 in term 0.
I20260807 15:19:52.618772 18721 raft_consensus.cc:2454] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35a2edf71a194840b885f8d8d3385813 in term 0.
I20260807 15:19:52.619081 18196 leader_election.cc:302] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a5af2b2d60b414899dd9d822808ab24, 35a2edf71a194840b885f8d8d3385813; no voters:
I20260807 15:19:52.619288 18852 raft_consensus.cc:2781] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:52.619359 18852 raft_consensus.cc:482] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:52.619386 18852 raft_consensus.cc:3037] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.620460 18852 raft_consensus.cc:504] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.620873 18852 leader_election.cc:288] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [CANDIDATE]: Term 1 election: Requested vote from peers 70c71972501944eb8db59692d68357e4 (127.15.242.194:34903), 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691)
I20260807 15:19:52.621194 18525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ced48483c6d463b8b376730cc0ed1a2" candidate_uuid: "35a2edf71a194840b885f8d8d3385813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c71972501944eb8db59692d68357e4"
I20260807 15:19:52.621340 18525 raft_consensus.cc:3037] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.621338 18721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ced48483c6d463b8b376730cc0ed1a2" candidate_uuid: "35a2edf71a194840b885f8d8d3385813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a5af2b2d60b414899dd9d822808ab24"
I20260807 15:19:52.621467 18721 raft_consensus.cc:3037] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:52.622359 18525 raft_consensus.cc:2454] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a2edf71a194840b885f8d8d3385813 in term 1.
I20260807 15:19:52.622372 18721 raft_consensus.cc:2454] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35a2edf71a194840b885f8d8d3385813 in term 1.
I20260807 15:19:52.622713 18196 leader_election.cc:302] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35a2edf71a194840b885f8d8d3385813, 70c71972501944eb8db59692d68357e4; no voters:
I20260807 15:19:52.622938 18852 raft_consensus.cc:2781] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:52.623077 18852 raft_consensus.cc:686] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [term 1 LEADER]: Becoming Leader. State: Replica: 35a2edf71a194840b885f8d8d3385813, State: Running, Role: LEADER
I20260807 15:19:52.623237 18852 consensus_queue.cc:237] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } }
I20260807 15:19:52.623974 18887 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: TxnStatusTablet state changed. Reason: New leader 35a2edf71a194840b885f8d8d3385813. Latest consensus state: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.624104 18887 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:19:52.624387 18907 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 15:19:52.624562 18907 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 15:19:52.625468 18050 catalog_manager.cc:5495] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35a2edf71a194840b885f8d8d3385813 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260807 15:19:52.670938 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.666668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:46073 (local address 127.0.0.1:52834)
0807 15:19:52.666921 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.666941 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.667058 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.667456 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.667459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.667468 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:19:52.667583 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.667589 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.668400 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.668404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.669100 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.669111 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.669601 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.669605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.669706 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.669753 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:19:52.670601 (+ 848us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:19:52.670626 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.670709 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.670820 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 15:19:52.670957 18911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.666798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52834 (local address 127.15.242.193:46073)
0807 15:19:52.667036 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.667041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.667057 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:19:52.667255 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.667257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.667317 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.667440 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:52.667707 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.668279 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.669233 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.669485 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.669600 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.669937 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:52.670367 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:52.670621 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.670728 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.670786 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":67,"threads_started":1}
I20260807 15:19:52.674677 18721 raft_consensus.cc:1261] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Refusing update from remote peer 35a2edf71a194840b885f8d8d3385813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:52.674780 18525 raft_consensus.cc:1261] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Refusing update from remote peer 35a2edf71a194840b885f8d8d3385813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:52.675314 18852 consensus_queue.cc:1035] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:52.675518 18887 consensus_queue.cc:1035] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:52.677395 18853 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: TxnStatusTablet state changed. Reason: New leader 35a2edf71a194840b885f8d8d3385813. Latest consensus state: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.677511 18853 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:52.678571 18860 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: TxnStatusTablet state changed. Reason: New leader 35a2edf71a194840b885f8d8d3385813. Latest consensus state: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.678660 18860 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:52.681339 18852 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.681481 18852 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:19:52.681622 18852 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.681710 18852 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 35a2edf71a194840b885f8d8d3385813: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:19:52.682191 18860 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.682315 18860 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 70c71972501944eb8db59692d68357e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:52.683512 18853 tablet_replica.cc:439] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "35a2edf71a194840b885f8d8d3385813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35a2edf71a194840b885f8d8d3385813" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46073 } } peers { permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 } } peers { permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 } } }
I20260807 15:19:52.683634 18853 tablet_replica.cc:442] T 3ced48483c6d463b8b376730cc0ed1a2 P 2a5af2b2d60b414899dd9d822808ab24: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:52.684336 18914 mvcc.cc:205] Tried to move back new op lower bound from 7315931105989562368 to 7315931105786384384. Current Snapshot: MvccSnapshot[applied={T|T < 7315931105989562368}]
I20260807 15:19:52.691522 18911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.688024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52844 (local address 127.15.242.193:46073)
0807 15:19:52.688223 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.688228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.688275 (+ 47us) server_negotiation.cc:407] Connection header received
0807 15:19:52.688462 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.688467 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.688522 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.688614 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:52.688869 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.689406 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.690333 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.690616 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.690774 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.691072 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:52.691150 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:52.691237 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.691336 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.691388 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260807 15:19:52.703598 18911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.699636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:57725 (local address 127.15.242.193:46073)
0807 15:19:52.699733 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.699737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.699868 (+ 131us) server_negotiation.cc:407] Connection header received
0807 15:19:52.699951 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.699954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.700002 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.700083 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:52.700381 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.701152 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.702251 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.702583 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.702682 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.703077 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:52.703167 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:52.703242 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.703409 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.703461 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 15:19:52.703598 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.699445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:46073 (local address 127.15.242.193:57725)
0807 15:19:52.699774 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:52.699788 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:52.699881 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:52.700133 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:52.700136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:52.700143 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:19:52.700262 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.700267 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.701302 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.701305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.702114 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:52.702126 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.702762 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.702767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:52.702870 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.702929 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:19:52.703292 (+ 363us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:19:52.703300 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 15:19:52.703371 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 15:19:52.703447 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260807 15:19:52.711345 18721 raft_consensus.cc:1261] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Refusing update from remote peer 35a2edf71a194840b885f8d8d3385813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:52.711360 18525 raft_consensus.cc:1261] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Refusing update from remote peer 35a2edf71a194840b885f8d8d3385813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:52.711761 18852 consensus_queue.cc:1035] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a5af2b2d60b414899dd9d822808ab24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:52.712078 18852 consensus_queue.cc:1035] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c71972501944eb8db59692d68357e4" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:52.763471 18053 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:52.763675 18053 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58810:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:52.766309 18053 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf0c3c6b959e426490664fe9ec812fc5: Sending DeleteTablet for 3 replicas of tablet 186394e9a79249dab0f2ffc336922201
I20260807 15:19:52.766980 18267 tablet_service.cc:1514] Processing DeleteTablet for tablet 186394e9a79249dab0f2ffc336922201 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:52 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:52832
I20260807 15:19:52.767252 18485 tablet_service.cc:1514] Processing DeleteTablet for tablet 186394e9a79249dab0f2ffc336922201 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:52 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:55964
I20260807 15:19:52.767668 18940 tablet_replica.cc:330] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: stopping tablet replica
I20260807 15:19:52.767743 18708 tablet_service.cc:1514] Processing DeleteTablet for tablet 186394e9a79249dab0f2ffc336922201 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:52 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:44748
I20260807 15:19:52.767969 18940 raft_consensus.cc:2229] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:52.768175 18940 raft_consensus.cc:2258] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:52.768184 18939 tablet_replica.cc:330] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: stopping tablet replica
I20260807 15:19:52.768324 18939 raft_consensus.cc:2229] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:19:52.768572 18941 tablet_replica.cc:330] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: stopping tablet replica
I20260807 15:19:52.768669 18939 raft_consensus.cc:2258] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:52.768718 18941 raft_consensus.cc:2229] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:52.769331 18940 ts_tablet_manager.cc:1905] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:52.769418 18939 ts_tablet_manager.cc:1905] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:52.773204 18940 ts_tablet_manager.cc:1918] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:52.773190 18939 ts_tablet_manager.cc:1918] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:52.773423 18939 log.cc:1196] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/186394e9a79249dab0f2ffc336922201
I20260807 15:19:52.773447 18940 log.cc:1196] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/186394e9a79249dab0f2ffc336922201
I20260807 15:19:52.773839 18939 ts_tablet_manager.cc:1939] T 186394e9a79249dab0f2ffc336922201 P 35a2edf71a194840b885f8d8d3385813: Deleting consensus metadata
I20260807 15:19:52.773958 18940 ts_tablet_manager.cc:1939] T 186394e9a79249dab0f2ffc336922201 P 70c71972501944eb8db59692d68357e4: Deleting consensus metadata
I20260807 15:19:52.774819 18941 raft_consensus.cc:2258] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:52.774832 18030 catalog_manager.cc:4841] TS 35a2edf71a194840b885f8d8d3385813 (127.15.242.193:46073): tablet 186394e9a79249dab0f2ffc336922201 (table test-table [id=52c6a8dc4cc9467d86f17777a5b46ebf]) successfully deleted
I20260807 15:19:52.775477 18032 catalog_manager.cc:4841] TS 70c71972501944eb8db59692d68357e4 (127.15.242.194:34903): tablet 186394e9a79249dab0f2ffc336922201 (table test-table [id=52c6a8dc4cc9467d86f17777a5b46ebf]) successfully deleted
I20260807 15:19:52.775765 18941 ts_tablet_manager.cc:1905] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 15:19:52 dist-test-slave-g170 krb5kdc[17995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115991, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:19:52.779351 18941 ts_tablet_manager.cc:1918] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:52.779487 18941 log.cc:1196] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/186394e9a79249dab0f2ffc336922201
I20260807 15:19:52.779865 18941 ts_tablet_manager.cc:1939] T 186394e9a79249dab0f2ffc336922201 P 2a5af2b2d60b414899dd9d822808ab24: Deleting consensus metadata
I20260807 15:19:52.780864 18032 catalog_manager.cc:4841] TS 2a5af2b2d60b414899dd9d822808ab24 (127.15.242.195:40691): tablet 186394e9a79249dab0f2ffc336922201 (table test-table [id=52c6a8dc4cc9467d86f17777a5b46ebf]) successfully deleted
I20260807 15:19:52.783926 18911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.769160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52858 (local address 127.15.242.193:46073)
0807 15:19:52.769286 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.769291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.769890 (+ 599us) server_negotiation.cc:407] Connection header received
0807 15:19:52.770103 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.770107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.770157 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.770213 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:52.771217 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.771979 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.773471 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.773903 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.774013 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.778945 (+ 4932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:52.778957 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:52.778976 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:52.779012 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:52.781722 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:52.782328 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:52.782334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:52.782336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:52.782437 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:52.782768 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:52.782770 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:52.782793 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:52.783065 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:52.783268 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.783552 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.783667 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 15:19:52.784415 18366 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52858
I20260807 15:19:52.794253 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:52.786365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58840 (local address 127.15.242.254:45705)
0807 15:19:52.786486 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:52.786489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:52.786537 (+ 48us) server_negotiation.cc:407] Connection header received
0807 15:19:52.786681 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:52.786683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:52.786723 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:52.786794 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:52.787639 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.788171 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.789299 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:52.789514 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:52.789604 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:52.791106 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:52.791109 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:52.791111 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:52.791134 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:52.792604 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:52.793133 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:52.793135 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:52.793136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:52.793210 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:52.793473 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:52.793475 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:52.793476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:52.793640 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:52.793736 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:52.793975 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 15:19:52.794072 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 15:19:52.794683 18053 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58840
I20260807 15:19:52.796454 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18167
I20260807 15:19:52.821761 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18385
I20260807 15:19:52.840401 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18606
I20260807 15:19:52.855902 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18011
2026-08-07T15:19:52Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3440 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:19:52 dist-test-slave-g170 krb5kdc[18951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:19:52 dist-test-slave-g170 krb5kdc[18951](info): set up 2 sockets
Aug 07 15:19:52 dist-test-slave-g170 krb5kdc[18951](info): commencing operation
krb5kdc: starting...
W20260807 15:19:54.139019 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:19:54 dist-test-slave-g170 krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:19:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:19:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:19:54.276631 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45653
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:45653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:54.393638 18968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:54.393900 18968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:54.393978 18968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:54.398041 18968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:19:54.398095 18968 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 15:19:54.398113 18968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:54.398131 18968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:54.398208 18968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:19:54.398247 18968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:19:54.403520 18968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:45653
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:54.404585 18968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:54.405707 18968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:54.414712 18979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:54.414739 18981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:54.414752 18976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:54.415167 18968 server_base.cc:1034] running on GCE node
I20260807 15:19:54.415704 18968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:54.416805 18968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:54.418015 18968 hybrid_clock.cc:648] HybridClock initialized: now 1786115994418000 us; error 27 us; skew 500 ppm
Aug 07 15:19:54 dist-test-slave-g170 krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115994, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:54.424419 18968 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:19:54.425459 18968 webserver.cc:460] Webserver started at http://127.15.242.254:41655/ using document root <none> and password file <none>
I20260807 15:19:54.426047 18968 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:54.426143 18968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:54.426407 18968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:54.428505 18968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "7073f142d4bc4e53a373b52b98cd7ace"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "227b1f421d2184ad32ee256ce3c03211"
server_key_iv: "8d26b53844fc9302266fd8f80b48e26f"
server_key_version: "encryptionkey@0"
I20260807 15:19:54.429106 18968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "7073f142d4bc4e53a373b52b98cd7ace"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "227b1f421d2184ad32ee256ce3c03211"
server_key_iv: "8d26b53844fc9302266fd8f80b48e26f"
server_key_version: "encryptionkey@0"
I20260807 15:19:54.433106 18968 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:19:54.435802 18997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:54.437354 18968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:54.437525 18968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "7073f142d4bc4e53a373b52b98cd7ace"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "227b1f421d2184ad32ee256ce3c03211"
server_key_iv: "8d26b53844fc9302266fd8f80b48e26f"
server_key_version: "encryptionkey@0"
I20260807 15:19:54.437667 18968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:54.481997 18968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:54.485920 18968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:54.486176 18968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:54.495661 18968 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:45653
I20260807 15:19:54.495682 19084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:45653 every 8 connection(s)
I20260807 15:19:54.496699 18968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:19:54.499698 19085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:54.505072 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18968
I20260807 15:19:54.505203 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:19:54.505472 19085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: Bootstrap starting.
I20260807 15:19:54.505569 16331 external_mini_cluster.cc:1428] Setting key 08513568370bae8718c40f46c9ea183b
I20260807 15:19:54.508175 19085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:54.509014 19085 log.cc:824] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:54.511248 19085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: No bootstrap required, opened a new log
Aug 07 15:19:54 dist-test-slave-g170 krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:54.516074 19085 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7073f142d4bc4e53a373b52b98cd7ace" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45653 } }
I20260807 15:19:54.516410 19085 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:54.516480 19085 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7073f142d4bc4e53a373b52b98cd7ace, State: Initialized, Role: FOLLOWER
I20260807 15:19:54.517086 19085 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7073f142d4bc4e53a373b52b98cd7ace" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45653 } }
I20260807 15:19:54.517287 19085 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:19:54.517374 19085 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:19:54.517490 19085 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:54.518431 19085 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7073f142d4bc4e53a373b52b98cd7ace" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45653 } }
I20260807 15:19:54.518808 19085 leader_election.cc:302] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7073f142d4bc4e53a373b52b98cd7ace; no voters:
I20260807 15:19:54.519176 19085 leader_election.cc:288] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:19:54.519251 19090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:54.519474 19090 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [term 1 LEADER]: Becoming Leader. State: Replica: 7073f142d4bc4e53a373b52b98cd7ace, State: Running, Role: LEADER
I20260807 15:19:54.519804 19090 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7073f142d4bc4e53a373b52b98cd7ace" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45653 } }
I20260807 15:19:54.520556 19085 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:19:54.521528 19091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7073f142d4bc4e53a373b52b98cd7ace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7073f142d4bc4e53a373b52b98cd7ace" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45653 } } }
I20260807 15:19:54.521673 19091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [sys.catalog]: This master's current role is: LEADER
I20260807 15:19:54.522024 19092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7073f142d4bc4e53a373b52b98cd7ace. Latest consensus state: current_term: 1 leader_uuid: "7073f142d4bc4e53a373b52b98cd7ace" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7073f142d4bc4e53a373b52b98cd7ace" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45653 } } }
I20260807 15:19:54.522125 19092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace [sys.catalog]: This master's current role is: LEADER
I20260807 15:19:54.522462 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:54.507031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49656 (local address 127.15.242.254:45653)
0807 15:19:54.507514 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:54.507531 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:54.507570 (+ 39us) server_negotiation.cc:407] Connection header received
0807 15:19:54.508435 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:54.508455 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:54.508897 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:54.509281 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:54.510313 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.511438 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.512577 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.513126 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.513250 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:54.516266 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:54.516273 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:54.516290 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:54.516327 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:54.518412 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:54.518914 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:54.518919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:54.518924 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:54.519099 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:54.519417 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:54.519421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:54.519423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:54.520130 (+ 707us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:54.520364 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:54.520740 (+ 376us) server_negotiation.cc:299] Negotiation successful
0807 15:19:54.521100 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":143,"threads_started":1}
W20260807 15:19:54.526194 19118 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:19:54.526335 19118 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:19:54.526475 19104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:19:54.527273 19104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:19:54.533226 19104 catalog_manager.cc:1347] Generated new cluster ID: 405c115b8e084f7f9e468c90ea3ef5ed
I20260807 15:19:54.533308 19104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:19:54.545606 19104 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:19:54.547345 19104 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:19:54.552940 19104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: Generated new TSK 0
I20260807 15:19:54.553618 19104 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:19:54.596210 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45653
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:54.732321 19125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:54.732620 19125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:54.732713 19125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:54.736658 19125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:54.736748 19125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:54.736841 19125 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 15:19:54.736891 19125 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:19:54.736959 19125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:19:54.742262 19125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:45653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:54.743391 19125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:54.744431 19125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:54.754194 19138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:54.754283 19135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:54.754184 19136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:54.754554 19125 server_base.cc:1034] running on GCE node
I20260807 15:19:54.754882 19125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:54.755494 19125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:54.756662 19125 hybrid_clock.cc:648] HybridClock initialized: now 1786115994756641 us; error 33 us; skew 500 ppm
Aug 07 15:19:54 dist-test-slave-g170 krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115994, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:54.759446 19125 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:19:54.760357 19125 webserver.cc:460] Webserver started at http://127.15.242.193:45269/ using document root <none> and password file <none>
I20260807 15:19:54.760954 19125 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:54.761023 19125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:54.761193 19125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:54.763128 19125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "669926f15bdf413493c5f97e056b8bb1"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "b6b0b6c02c8f2c40c30bf38b4492cdd9"
server_key_iv: "73b03be85b4fbb03f7482a1ee86bd142"
server_key_version: "encryptionkey@0"
I20260807 15:19:54.763649 19125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "669926f15bdf413493c5f97e056b8bb1"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "b6b0b6c02c8f2c40c30bf38b4492cdd9"
server_key_iv: "73b03be85b4fbb03f7482a1ee86bd142"
server_key_version: "encryptionkey@0"
I20260807 15:19:54.767689 19125 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:19:54.770392 19145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:54.771721 19125 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:19:54.771868 19125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "669926f15bdf413493c5f97e056b8bb1"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "b6b0b6c02c8f2c40c30bf38b4492cdd9"
server_key_iv: "73b03be85b4fbb03f7482a1ee86bd142"
server_key_version: "encryptionkey@0"
I20260807 15:19:54.771960 19125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:54.781412 19125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:54.784260 19125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:54.784405 19125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:54.785948 19125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:54.786026 19125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:54.786101 19125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:54.786156 19125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:19:54 dist-test-slave-g170 krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115994, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:54.797649 19125 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:43173
I20260807 15:19:54.797762 19324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:43173 every 8 connection(s)
I20260807 15:19:54.798578 19125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:19:54.801651 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:54.787028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:55015 (local address 127.15.242.254:45653)
0807 15:19:54.787195 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:54.787200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:54.788117 (+ 917us) server_negotiation.cc:407] Connection header received
0807 15:19:54.789608 (+ 1491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:54.789613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:54.789692 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:54.789804 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:54.791382 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.792191 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.793702 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.794006 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.794160 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:54.797260 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:54.797265 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:54.797267 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:54.797327 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:54.799375 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:54.800004 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:54.800010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:54.800012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:54.800145 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:54.800516 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:54.800519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:54.800521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:54.800740 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:54.800912 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:54.801377 (+ 465us) server_negotiation.cc:299] Negotiation successful
0807 15:19:54.801498 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 15:19:54.802311 19161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:54.787399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45653 (local address 127.15.242.193:55015)
0807 15:19:54.787930 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:54.787987 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:54.789263 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:54.790041 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:54.790053 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:54.790500 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:54.791208 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:54.791226 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.792359 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.792363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:54.793542 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:54.793554 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.794228 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.794233 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:54.794455 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:54.795167 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:54.795186 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:54.797050 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:54.799512 (+ 2462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:54.799518 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:54.799531 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:54.799853 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:54.800242 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:54.800244 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:54.800245 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:54.800400 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:54.800914 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:54.800919 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:54.801123 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 15:19:54.801277 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 15:19:54.801502 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":152,"threads_started":1}
I20260807 15:19:54.803777 19325 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45653
I20260807 15:19:54.803956 19325 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:54.804423 19325 heartbeater.cc:511] Master 127.15.242.254:45653 requested a full tablet report, sending...
I20260807 15:19:54.804996 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 19125
I20260807 15:19:54.805124 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:19:54.805393 16331 external_mini_cluster.cc:1428] Setting key 9c9a9cea06a5066ae921d9a16eb8e7f3
I20260807 15:19:54.807336 19026 ts_manager.cc:194] Registered new tserver with Master: 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173)
I20260807 15:19:54.809149 19026 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:55015
I20260807 15:19:54.817346 19335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:54.806473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45653 (local address 127.15.242.193:50191)
0807 15:19:54.806902 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:54.806916 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:54.807006 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:54.809088 (+ 2082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:54.809091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:54.809327 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:54.809445 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:54.809451 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.810573 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.810577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:54.811531 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:54.811545 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.812218 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.812222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:54.812317 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:54.813002 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:54.813017 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:54.813428 (+ 411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:54.815594 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:54.815599 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:54.815601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:54.815848 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:54.816204 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:54.816207 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:54.816209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:54.816312 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:54.816880 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:54.816882 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:54.816965 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 15:19:54.817065 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 15:19:54.817194 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":4,"thread_start_us":82,"threads_started":1}
I20260807 15:19:54.817440 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:54.806602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:50191 (local address 127.15.242.254:45653)
0807 15:19:54.808897 (+ 2295us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:54.808900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:54.808911 (+ 11us) server_negotiation.cc:407] Connection header received
0807 15:19:54.808940 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:54.808942 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:54.808974 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:54.809070 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:54.809562 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.810407 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.811689 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:54.812085 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:54.812209 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:54.813594 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:54.813601 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:54.813607 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:54.813649 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:54.815449 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:54.815968 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:54.815972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:54.815974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:54.816065 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:54.816429 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:54.816433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:54.816435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:54.816708 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:54.816855 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:54.817163 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 15:19:54.817287 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2224}
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:19:54.840134 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45653
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:54.962962 19338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:54.963244 19338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:54.963295 19338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:54.967573 19338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:54.967641 19338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:54.967684 19338 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 15:19:54.967697 19338 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:19:54.967731 19338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:19:54.973407 19338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:45653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:54.974512 19338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:54.975608 19338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:54.986399 19346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:54.986388 19345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:54.986510 19338 server_base.cc:1034] running on GCE node
W20260807 15:19:54.986388 19348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:54.987140 19338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:54.987867 19338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:54.989042 19338 hybrid_clock.cc:648] HybridClock initialized: now 1786115994989002 us; error 48 us; skew 500 ppm
Aug 07 15:19:54 dist-test-slave-g170 krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115994, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:54.992102 19338 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:19:54.993156 19338 webserver.cc:460] Webserver started at http://127.15.242.194:37295/ using document root <none> and password file <none>
I20260807 15:19:54.993866 19338 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:54.993979 19338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:54.994270 19338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:54.996507 19338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "dad846b93df943cfae4b429773a58d97"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "2483ce7dba90583715211780f082f29d"
server_key_iv: "db59d9135d154d5acda52cd4a31fb5a0"
server_key_version: "encryptionkey@0"
I20260807 15:19:54.997212 19338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "dad846b93df943cfae4b429773a58d97"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "2483ce7dba90583715211780f082f29d"
server_key_iv: "db59d9135d154d5acda52cd4a31fb5a0"
server_key_version: "encryptionkey@0"
I20260807 15:19:55.001565 19338 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:19:55.004377 19356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:55.005967 19338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:55.006140 19338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "dad846b93df943cfae4b429773a58d97"
format_stamp: "Formatted at 2026-08-07 15:19:54 on dist-test-slave-g170"
server_key: "2483ce7dba90583715211780f082f29d"
server_key_iv: "db59d9135d154d5acda52cd4a31fb5a0"
server_key_version: "encryptionkey@0"
I20260807 15:19:55.006273 19338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:55.030493 19338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:55.034030 19338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:55.034286 19338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:55.036002 19338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:55.036100 19338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:55.036186 19338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:55.036249 19338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:19:55 dist-test-slave-g170 krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115994, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:55.049961 19338 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:45365
I20260807 15:19:55.049996 19521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:45365 every 8 connection(s)
I20260807 15:19:55.051010 19338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:19:55.053632 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.037195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:44783 (local address 127.15.242.254:45653)
0807 15:19:55.037344 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.037348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.038606 (+ 1258us) server_negotiation.cc:407] Connection header received
0807 15:19:55.040002 (+ 1396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.040007 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.040112 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.040233 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:55.041816 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.042719 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.044646 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.045019 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.045156 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.049003 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:55.049010 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:55.049019 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:55.049048 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:55.050994 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.051693 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.051697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.051699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.051803 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.052274 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.052280 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.052286 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.052513 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:55.052639 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.053283 (+ 644us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.053428 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 15:19:55.054443 19369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.037823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45653 (local address 127.15.242.194:44783)
0807 15:19:55.038417 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.038466 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.039649 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.040470 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.040478 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.041058 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:55.041639 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.041655 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.042852 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.042856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.044492 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.044503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.045242 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.045248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.045463 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.046173 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:55.046195 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:55.048741 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:55.051139 (+ 2398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.051148 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.051163 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.051531 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.051904 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.051909 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.051911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.052144 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.052634 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:55.052639 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:55.052976 (+ 337us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.053223 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.053572 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":164,"threads_started":1}
I20260807 15:19:55.055894 19523 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45653
I20260807 15:19:55.056056 19523 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:55.056815 19523 heartbeater.cc:511] Master 127.15.242.254:45653 requested a full tablet report, sending...
I20260807 15:19:55.058071 19024 ts_manager.cc:194] Registered new tserver with Master: dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365)
I20260807 15:19:55.058629 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 19338
I20260807 15:19:55.058751 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:19:55.058807 19024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:44783
I20260807 15:19:55.059114 16331 external_mini_cluster.cc:1428] Setting key 0ea9e45790ba721d3f0b3daadaa8d8b7
I20260807 15:19:55.069312 19536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.058743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45653 (local address 127.15.242.194:42755)
0807 15:19:55.059871 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.059887 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.060027 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.060323 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.060326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.060600 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:55.060774 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.060818 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.062023 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.062026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.063114 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.063144 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.063712 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.063716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.063820 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.064432 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:55.064455 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:55.064922 (+ 467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:55.067308 (+ 2386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.067311 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.067313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.067532 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.067943 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.067946 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.067948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.068041 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.068703 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:55.068706 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:55.068879 (+ 173us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.068981 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.069122 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1021,"thread_start_us":117,"threads_started":1}
I20260807 15:19:55.069538 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.059097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:42755 (local address 127.15.242.254:45653)
0807 15:19:55.059242 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.059246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.059980 (+ 734us) server_negotiation.cc:407] Connection header received
0807 15:19:55.060141 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.060144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.060204 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.060301 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:55.060966 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.061819 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.063319 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.063569 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.063710 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.065081 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:55.065089 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:55.065095 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:55.065130 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:55.067178 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.067662 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.067670 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.067674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.067796 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.068163 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.068169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.068171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.068553 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:55.068701 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.069101 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.069279 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:19:55.095932 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45653
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:19:55.215143 19540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:19:55.215422 19540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:19:55.215502 19540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:19:55.219573 19540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:19:55.219641 19540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:19:55.219682 19540 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 15:19:55.219743 19540 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:19:55.219811 19540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:19:55.225517 19540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:45653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:19:55.226678 19540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:19:55.227767 19540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:19:55.238178 19555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:55.238278 19540 server_base.cc:1034] running on GCE node
W20260807 15:19:55.238179 19552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:19:55.238170 19550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:19:55.238839 19540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:19:55.239502 19540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:19:55.240695 19540 hybrid_clock.cc:648] HybridClock initialized: now 1786115995240682 us; error 30 us; skew 500 ppm
Aug 07 15:19:55 dist-test-slave-g170 krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115995, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:19:55.244107 19540 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:19:55.245187 19540 webserver.cc:460] Webserver started at http://127.15.242.195:38031/ using document root <none> and password file <none>
I20260807 15:19:55.245769 19540 fs_manager.cc:359] Metadata directory not provided
I20260807 15:19:55.245836 19540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:19:55.246019 19540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:19:55.248235 19540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "3e05df96bd3c489ca305b04fafa8c8e6"
format_stamp: "Formatted at 2026-08-07 15:19:55 on dist-test-slave-g170"
server_key: "0a90ce84fd8ca34ed293c4a6c7e084e3"
server_key_iv: "17ad999967c0a9dcf1f93e4d64c10dc6"
server_key_version: "encryptionkey@0"
I20260807 15:19:55.248919 19540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "3e05df96bd3c489ca305b04fafa8c8e6"
format_stamp: "Formatted at 2026-08-07 15:19:55 on dist-test-slave-g170"
server_key: "0a90ce84fd8ca34ed293c4a6c7e084e3"
server_key_iv: "17ad999967c0a9dcf1f93e4d64c10dc6"
server_key_version: "encryptionkey@0"
I20260807 15:19:55.252997 19540 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:19:55.255594 19568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:55.257036 19540 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:19:55.257157 19540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "3e05df96bd3c489ca305b04fafa8c8e6"
format_stamp: "Formatted at 2026-08-07 15:19:55 on dist-test-slave-g170"
server_key: "0a90ce84fd8ca34ed293c4a6c7e084e3"
server_key_iv: "17ad999967c0a9dcf1f93e4d64c10dc6"
server_key_version: "encryptionkey@0"
I20260807 15:19:55.257267 19540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:19:55.272318 19540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:19:55.275777 19540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:19:55.275995 19540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:19:55.277578 19540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:19:55.277652 19540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:19:55.277750 19540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:19:55.277796 19540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:19:55 dist-test-slave-g170 krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115995, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:55.288949 19540 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:41083
I20260807 15:19:55.289029 19738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:41083 every 8 connection(s)
I20260807 15:19:55.289978 19540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:19:55.292022 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.278226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:60305 (local address 127.15.242.254:45653)
0807 15:19:55.278412 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.278417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.279811 (+ 1394us) server_negotiation.cc:407] Connection header received
0807 15:19:55.281229 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.281233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.281289 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.281365 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:55.283067 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.283736 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.285057 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.285328 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.285434 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.288250 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:55.288253 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:55.288255 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:55.288281 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:55.289842 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.290482 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.290486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.290488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.290586 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.291024 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.291027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.291029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.291230 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:55.291314 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.291795 (+ 481us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.291902 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 15:19:55.292906 19583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.279115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45653 (local address 127.15.242.195:60305)
0807 15:19:55.279625 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.279689 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.280968 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.281603 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.281613 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.282135 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:55.282909 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.282932 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.283872 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.283876 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.284928 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.284939 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.285469 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.285473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.285656 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.286255 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:55.286270 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:55.288071 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:55.289968 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.289974 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.289989 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.290343 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.290705 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.290710 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.290712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.290887 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.291348 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:55.291353 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:55.291571 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.291734 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.291985 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":109,"threads_started":1}
I20260807 15:19:55.294134 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 19540
I20260807 15:19:55.294268 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:19:55.294477 19743 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45653
I20260807 15:19:55.294627 16331 external_mini_cluster.cc:1428] Setting key 20bae4aed7a68964f8b9ee8cedcaaec9
I20260807 15:19:55.294719 19743 heartbeater.cc:464] Registering TS with master...
I20260807 15:19:55.295349 19743 heartbeater.cc:511] Master 127.15.242.254:45653 requested a full tablet report, sending...
I20260807 15:19:55.296540 19026 ts_manager.cc:194] Registered new tserver with Master: 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:55.297284 19026 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:60305
I20260807 15:19:55.304716 19750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.297022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45653 (local address 127.15.242.195:34975)
0807 15:19:55.297380 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.297420 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.297553 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.297830 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.297833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.298097 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:55.298254 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.298266 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.299087 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.299091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.299855 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.299865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.300317 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.300321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.300413 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.300952 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:55.300965 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:55.301304 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:55.303145 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.303148 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.303149 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.303430 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.303689 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.303692 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.303693 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.303779 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.304196 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:55.304199 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:55.304281 (+ 82us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.304379 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.304541 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":6,"thread_start_us":106,"threads_started":1}
I20260807 15:19:55.304725 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.297069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:34975 (local address 127.15.242.254:45653)
0807 15:19:55.297218 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.297223 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.297502 (+ 279us) server_negotiation.cc:407] Connection header received
0807 15:19:55.297655 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.297658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.297702 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.297796 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:55.298407 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.298936 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.299968 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.300169 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.300256 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.301435 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:55.301438 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:55.301440 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:55.301461 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:55.303009 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.303524 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.303526 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.303528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.303600 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.303921 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.303924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.303925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.304095 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:55.304187 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.304424 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.304568 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 15:19:55.308692 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 15:19:55 dist-test-slave-g170 krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 15:19:55 dist-test-slave-g170 krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115995, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:55.339002 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.329317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49662 (local address 127.15.242.254:45653)
0807 15:19:55.329477 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.329481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.329496 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:19:55.329544 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.329547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.329589 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.329700 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:55.330539 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.331126 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.332107 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.332358 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.332494 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.335356 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:55.335360 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:55.335362 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:55.335393 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:55.336967 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.337488 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.337493 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.337495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.337602 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.337969 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.337973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.337975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.338198 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:55.338396 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.338669 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.338812 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 15:19:55.342386 19026 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:19:55.345593 19026 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:55.361220 19780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.355281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:43173 (local address 127.0.0.1:41214)
0807 15:19:55.355564 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.355577 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.355664 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.356560 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.356563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.356582 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:55.356680 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.356687 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.357825 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.357832 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.359548 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.359558 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.360454 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.360457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.360581 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.360621 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.360736 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.361059 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":92,"thread_start_us":111,"threads_started":1}
I20260807 15:19:55.361310 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.354644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53486 (local address 127.15.242.194:45365)
0807 15:19:55.355521 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.355538 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.355567 (+ 29us) server_negotiation.cc:407] Connection header received
0807 15:19:55.355652 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.355660 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.355945 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.356125 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:55.356648 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.357992 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.359659 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.360578 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.360749 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.360951 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.361013 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.361111 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":154,"threads_started":1}
I20260807 15:19:55.361320 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.355757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41214 (local address 127.15.242.193:43173)
0807 15:19:55.356100 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.356106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.356129 (+ 23us) server_negotiation.cc:407] Connection header received
0807 15:19:55.356207 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.356213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.356408 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.356567 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:55.356850 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.357700 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.359681 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.360320 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.360469 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.360621 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.361045 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.361143 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":85,"threads_started":1}
I20260807 15:19:55.361521 19778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.354550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:41083 (local address 127.0.0.1:40980)
0807 15:19:55.355095 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.355111 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.355219 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.356852 (+ 1633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.356855 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.356874 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:55.356962 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.356968 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.358437 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.358443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.359722 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.359733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.361021 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.361025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.361120 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.361145 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.361215 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.361282 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":58,"thread_start_us":117,"threads_started":1}
I20260807 15:19:55.362118 19781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.355352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.15.242.195:41083)
0807 15:19:55.356186 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.356199 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.356237 (+ 38us) server_negotiation.cc:407] Connection header received
0807 15:19:55.356323 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.356329 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.356525 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.356690 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:55.357109 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.358293 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.359884 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.360740 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.361579 (+ 839us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.361730 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.361792 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.361953 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":139,"threads_started":1}
I20260807 15:19:55.362180 19777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.354497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:45365 (local address 127.0.0.1:53486)
0807 15:19:55.354930 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.354979 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.355106 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.356319 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.356326 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.356353 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:55.356487 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.356495 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.358132 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.358136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.359511 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.359523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.360706 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.360712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.360830 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.360853 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.360916 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.362023 (+ 1107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":51,"thread_start_us":92,"threads_started":1}
I20260807 15:19:55.365193 19648 tablet_service.cc:1467] Processing CreateTablet for tablet df8fe075251443a9a1e61b5cf199b131 (DEFAULT_TABLE table=test-table [id=16b18a121d25484e9fba50ba7cc8a382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:55.365231 19216 tablet_service.cc:1467] Processing CreateTablet for tablet df8fe075251443a9a1e61b5cf199b131 (DEFAULT_TABLE table=test-table [id=16b18a121d25484e9fba50ba7cc8a382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:55.365445 19431 tablet_service.cc:1467] Processing CreateTablet for tablet df8fe075251443a9a1e61b5cf199b131 (DEFAULT_TABLE table=test-table [id=16b18a121d25484e9fba50ba7cc8a382]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:55.366432 19431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df8fe075251443a9a1e61b5cf199b131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.366433 19216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df8fe075251443a9a1e61b5cf199b131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.366441 19648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df8fe075251443a9a1e61b5cf199b131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.373440 19784 tablet_bootstrap.cc:492] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: Bootstrap starting.
I20260807 15:19:55.375021 19785 tablet_bootstrap.cc:492] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: Bootstrap starting.
I20260807 15:19:55.375735 19786 tablet_bootstrap.cc:492] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: Bootstrap starting.
I20260807 15:19:55.376362 19784 tablet_bootstrap.cc:654] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.377277 19785 tablet_bootstrap.cc:654] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.377377 19784 log.cc:824] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:55.378042 19786 tablet_bootstrap.cc:654] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.378149 19785 log.cc:824] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:55.378988 19786 log.cc:824] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: Log is configured to *not* fsync() on all Append() calls
I20260807 15:19:55.379727 19784 tablet_bootstrap.cc:492] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: No bootstrap required, opened a new log
I20260807 15:19:55.380003 19784 ts_tablet_manager.cc:1397] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:19:55.380342 19785 tablet_bootstrap.cc:492] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: No bootstrap required, opened a new log
I20260807 15:19:55.380532 19785 ts_tablet_manager.cc:1397] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:19:55.381088 19786 tablet_bootstrap.cc:492] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: No bootstrap required, opened a new log
I20260807 15:19:55.381299 19786 ts_tablet_manager.cc:1397] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:19:55.384384 19784 raft_consensus.cc:348] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.384672 19784 raft_consensus.cc:374] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.384790 19784 raft_consensus.cc:729] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e05df96bd3c489ca305b04fafa8c8e6, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.385016 19786 raft_consensus.cc:348] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.385120 19785 raft_consensus.cc:348] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.385311 19786 raft_consensus.cc:374] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.385286 19784 consensus_queue.cc:260] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.385375 19786 raft_consensus.cc:729] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad846b93df943cfae4b429773a58d97, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.385386 19785 raft_consensus.cc:374] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.385439 19785 raft_consensus.cc:729] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669926f15bdf413493c5f97e056b8bb1, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.385854 19786 consensus_queue.cc:260] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.385938 19785 consensus_queue.cc:260] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.386382 19784 ts_tablet_manager.cc:1428] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 15:19:55.386739 19743 heartbeater.cc:503] Master 127.15.242.254:45653 was elected leader, sending a full tablet report...
I20260807 15:19:55.386827 19325 heartbeater.cc:503] Master 127.15.242.254:45653 was elected leader, sending a full tablet report...
I20260807 15:19:55.386868 19785 ts_tablet_manager.cc:1428] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:19:55.386947 19786 ts_tablet_manager.cc:1428] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:19:55.387346 19523 heartbeater.cc:503] Master 127.15.242.254:45653 was elected leader, sending a full tablet report...
I20260807 15:19:55.430251 19794 raft_consensus.cc:482] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:55.430485 19794 raft_consensus.cc:504] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.431986 19794 leader_election.cc:288] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:55.436208 19781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.432437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:47721 (local address 127.15.242.195:41083)
0807 15:19:55.432635 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.432642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.432681 (+ 39us) server_negotiation.cc:407] Connection header received
0807 15:19:55.432896 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.432902 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.432985 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.433074 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:55.433468 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.434004 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.435175 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.435589 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.435733 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.435794 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.435996 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.436069 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260807 15:19:55.436247 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.432234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:41083 (local address 127.15.242.193:47721)
0807 15:19:55.432608 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.432620 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.432781 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.433117 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.433120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.433138 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:55.433306 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.433313 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.434155 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.434159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.435019 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.435030 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.435728 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.435732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.435848 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.435869 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.435963 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.436044 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":28,"thread_start_us":119,"threads_started":1}
I20260807 15:19:55.436267 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.432353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:46261 (local address 127.15.242.194:45365)
0807 15:19:55.432599 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.432604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.432755 (+ 151us) server_negotiation.cc:407] Connection header received
0807 15:19:55.432940 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.432947 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.433005 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.433096 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:55.433495 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.434213 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.435250 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.435664 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.435801 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.435859 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.436059 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.436128 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260807 15:19:55.436280 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.432231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:45365 (local address 127.15.242.193:46261)
0807 15:19:55.432592 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.432607 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.432797 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.433256 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.433259 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.433277 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:55.433386 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.433395 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.434338 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.434344 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.435106 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.435116 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.435796 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.435800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.435926 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.435945 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.436040 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.436112 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":137,"threads_started":1}
I20260807 15:19:55.436882 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df8fe075251443a9a1e61b5cf199b131" candidate_uuid: "669926f15bdf413493c5f97e056b8bb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" is_pre_election: true
I20260807 15:19:55.436981 19459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df8fe075251443a9a1e61b5cf199b131" candidate_uuid: "669926f15bdf413493c5f97e056b8bb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dad846b93df943cfae4b429773a58d97" is_pre_election: true
I20260807 15:19:55.437258 19679 raft_consensus.cc:2454] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669926f15bdf413493c5f97e056b8bb1 in term 0.
I20260807 15:19:55.437315 19459 raft_consensus.cc:2454] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669926f15bdf413493c5f97e056b8bb1 in term 0.
I20260807 15:19:55.437848 19150 leader_election.cc:302] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3e05df96bd3c489ca305b04fafa8c8e6, 669926f15bdf413493c5f97e056b8bb1, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:55.438126 19794 raft_consensus.cc:2781] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:55.438234 19794 raft_consensus.cc:482] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:55.438297 19794 raft_consensus.cc:3037] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:55.439432 19794 raft_consensus.cc:504] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.439821 19794 leader_election.cc:288] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [CANDIDATE]: Term 1 election: Requested vote from peers dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:55.440299 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df8fe075251443a9a1e61b5cf199b131" candidate_uuid: "669926f15bdf413493c5f97e056b8bb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6"
I20260807 15:19:55.440299 19459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df8fe075251443a9a1e61b5cf199b131" candidate_uuid: "669926f15bdf413493c5f97e056b8bb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dad846b93df943cfae4b429773a58d97"
I20260807 15:19:55.440455 19679 raft_consensus.cc:3037] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:55.440455 19459 raft_consensus.cc:3037] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:55.441983 19679 raft_consensus.cc:2454] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669926f15bdf413493c5f97e056b8bb1 in term 1.
I20260807 15:19:55.441983 19459 raft_consensus.cc:2454] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669926f15bdf413493c5f97e056b8bb1 in term 1.
I20260807 15:19:55.442401 19149 leader_election.cc:302] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669926f15bdf413493c5f97e056b8bb1, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:55.442655 19794 raft_consensus.cc:2781] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:55.443069 19794 raft_consensus.cc:686] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 1 LEADER]: Becoming Leader. State: Replica: 669926f15bdf413493c5f97e056b8bb1, State: Running, Role: LEADER
I20260807 15:19:55.443558 19794 consensus_queue.cc:237] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } }
I20260807 15:19:55.447163 19024 catalog_manager.cc:5495] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "669926f15bdf413493c5f97e056b8bb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } health_report { overall_health: HEALTHY } } }
Aug 07 15:19:55 dist-test-slave-g170 krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115994, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:55.492543 19088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.482918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49668 (local address 127.15.242.254:45653)
0807 15:19:55.483109 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.483115 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.483315 (+ 200us) server_negotiation.cc:407] Connection header received
0807 15:19:55.483507 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.483510 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.483555 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.483654 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:55.484429 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.485075 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.486045 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.486289 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.486470 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.489141 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:55.489144 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:55.489146 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:55.489169 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:55.490635 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.491159 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.491163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.491165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.491249 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:55.491539 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:55.491542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:55.491544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:55.491793 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:55.491911 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.492220 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.492384 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":63}
I20260807 15:19:55.492544 19805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.482782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45653 (local address 127.0.0.1:49668)
0807 15:19:55.483200 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.483215 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.483379 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.483675 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.483678 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.484164 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:19:55.484276 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.484283 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.485203 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.485209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.485904 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.485914 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.486421 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.486424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.486537 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.487211 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:19:55.487227 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:19:55.488969 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:19:55.490780 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.490791 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.490799 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.491042 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.491343 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:19:55.491348 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:19:55.491350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:19:55.491436 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:19:55.491911 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:19:55.491920 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:19:55.492035 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.492160 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.492333 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":4,"thread_start_us":141,"threads_started":1}
I20260807 15:19:55.497756 19024 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:49668:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 15:19:55.498574 19024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:55.504177 19216 tablet_service.cc:1467] Processing CreateTablet for tablet c18fc0ae64fd42cfae216939c7acd732 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1fa791749f2411db377d71014ef262b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:19:55.504426 19648 tablet_service.cc:1467] Processing CreateTablet for tablet c18fc0ae64fd42cfae216939c7acd732 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1fa791749f2411db377d71014ef262b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:19:55.504441 19431 tablet_service.cc:1467] Processing CreateTablet for tablet c18fc0ae64fd42cfae216939c7acd732 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c1fa791749f2411db377d71014ef262b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:19:55.505195 19216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c18fc0ae64fd42cfae216939c7acd732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.505199 19431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c18fc0ae64fd42cfae216939c7acd732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.505200 19648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c18fc0ae64fd42cfae216939c7acd732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.507918 19785 tablet_bootstrap.cc:492] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: Bootstrap starting.
I20260807 15:19:55.508271 19784 tablet_bootstrap.cc:492] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: Bootstrap starting.
I20260807 15:19:55.508612 19786 tablet_bootstrap.cc:492] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: Bootstrap starting.
I20260807 15:19:55.509039 19785 tablet_bootstrap.cc:654] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.509346 19784 tablet_bootstrap.cc:654] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.509714 19786 tablet_bootstrap.cc:654] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.511044 19784 tablet_bootstrap.cc:492] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: No bootstrap required, opened a new log
I20260807 15:19:55.511126 19784 ts_tablet_manager.cc:1397] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:55.511579 19784 raft_consensus.cc:348] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.511696 19784 raft_consensus.cc:374] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.511734 19784 raft_consensus.cc:729] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e05df96bd3c489ca305b04fafa8c8e6, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.511812 19786 tablet_bootstrap.cc:492] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: No bootstrap required, opened a new log
I20260807 15:19:55.511868 19784 consensus_queue.cc:260] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.511937 19786 ts_tablet_manager.cc:1397] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:55.512153 19784 ts_tablet_manager.cc:1428] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 15:19:55.512221 19791 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.512423 19791 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:55.512540 19786 raft_consensus.cc:348] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.512651 19786 raft_consensus.cc:374] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.512684 19786 raft_consensus.cc:729] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad846b93df943cfae4b429773a58d97, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.512835 19786 consensus_queue.cc:260] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.513093 19786 ts_tablet_manager.cc:1428] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 15:19:55.513124 19793 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.513288 19793 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:55.517678 19785 tablet_bootstrap.cc:492] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: No bootstrap required, opened a new log
I20260807 15:19:55.517791 19785 ts_tablet_manager.cc:1397] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260807 15:19:55.518273 19785 raft_consensus.cc:348] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.518401 19785 raft_consensus.cc:374] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.518426 19785 raft_consensus.cc:729] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669926f15bdf413493c5f97e056b8bb1, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.518610 19785 consensus_queue.cc:260] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.518921 19785 ts_tablet_manager.cc:1428] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 15:19:55.518958 19794 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.519134 19794 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 15:19:55.541100 19744 tablet.cc:2369] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:19:55.549993 19327 tablet.cc:2369] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:19:55.552332 19526 tablet.cc:2369] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:19:55.771893 19793 raft_consensus.cc:482] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:55.772091 19793 raft_consensus.cc:504] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.773375 19793 leader_election.cc:288] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:55.779127 19781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.773808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:41277 (local address 127.15.242.195:41083)
0807 15:19:55.773948 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.773952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.774151 (+ 199us) server_negotiation.cc:407] Connection header received
0807 15:19:55.774337 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.774341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.774394 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.774483 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:55.774756 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.775589 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.777707 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.778356 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.778486 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.778543 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.778920 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.778992 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 15:19:55.779129 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.773796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:59055 (local address 127.15.242.193:43173)
0807 15:19:55.773945 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.773952 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.774345 (+ 393us) server_negotiation.cc:407] Connection header received
0807 15:19:55.774513 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.774518 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.774567 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.774661 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:19:55.775021 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.775800 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.777707 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.778353 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.778486 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.778543 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.778916 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.778994 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 15:19:55.779191 19814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.773719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:43173 (local address 127.15.242.194:59055)
0807 15:19:55.774228 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.774241 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.774390 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.774722 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.774725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.774746 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:55.774899 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.774907 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.775902 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.775906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.777535 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.777543 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.778501 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.778505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.778782 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.778802 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.778877 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.778983 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"mutex_wait_us":235,"thread_start_us":72,"threads_started":1}
I20260807 15:19:55.779193 19815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.773694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:41083 (local address 127.15.242.194:41277)
0807 15:19:55.774052 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.774065 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.774213 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.774498 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.774500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.774518 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:19:55.774641 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.774647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.775790 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.775795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.777530 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.777543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.778501 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.778505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.778686 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.778781 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.778876 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.778983 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":185,"thread_start_us":98,"threads_started":1}
I20260807 15:19:55.779867 19252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c18fc0ae64fd42cfae216939c7acd732" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669926f15bdf413493c5f97e056b8bb1" is_pre_election: true
I20260807 15:19:55.780117 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c18fc0ae64fd42cfae216939c7acd732" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" is_pre_election: true
I20260807 15:19:55.780156 19252 raft_consensus.cc:2454] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 0.
I20260807 15:19:55.780272 19679 raft_consensus.cc:2454] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 0.
I20260807 15:19:55.780648 19358 leader_election.cc:302] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3e05df96bd3c489ca305b04fafa8c8e6, 669926f15bdf413493c5f97e056b8bb1, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:55.781008 19793 raft_consensus.cc:2781] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:55.781073 19793 raft_consensus.cc:482] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:55.781104 19793 raft_consensus.cc:3037] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:55.782236 19793 raft_consensus.cc:504] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.782631 19793 leader_election.cc:288] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 election: Requested vote from peers 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:55.783028 19252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c18fc0ae64fd42cfae216939c7acd732" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669926f15bdf413493c5f97e056b8bb1"
I20260807 15:19:55.783044 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c18fc0ae64fd42cfae216939c7acd732" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6"
I20260807 15:19:55.783170 19252 raft_consensus.cc:3037] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:55.783200 19679 raft_consensus.cc:3037] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:55.784490 19679 raft_consensus.cc:2454] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 1.
I20260807 15:19:55.784570 19252 raft_consensus.cc:2454] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 1.
I20260807 15:19:55.784917 19361 leader_election.cc:302] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e05df96bd3c489ca305b04fafa8c8e6, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:55.785164 19793 raft_consensus.cc:2781] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:55.785398 19793 raft_consensus.cc:686] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [term 1 LEADER]: Becoming Leader. State: Replica: dad846b93df943cfae4b429773a58d97, State: Running, Role: LEADER
I20260807 15:19:55.785779 19793 consensus_queue.cc:237] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.788184 19816 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: TxnStatusTablet state changed. Reason: New leader dad846b93df943cfae4b429773a58d97. Latest consensus state: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.788311 19816 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:19:55.789073 19818 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 15:19:55.789314 19818 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 15:19:55.789677 19022 catalog_manager.cc:5495] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 reported cstate change: term changed from 0 to 1, leader changed from <none> to dad846b93df943cfae4b429773a58d97 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } health_report { overall_health: UNKNOWN } } }
I20260807 15:19:55.815315 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.811270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53494 (local address 127.15.242.194:45365)
0807 15:19:55.811430 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.811434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.811448 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:19:55.811517 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.811519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.811573 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.811665 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:55.811967 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.812514 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.813834 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.814064 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.814154 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.814488 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:55.814916 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:55.815010 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.815136 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.815203 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 15:19:55.815346 19805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.810984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:45365 (local address 127.0.0.1:53494)
0807 15:19:55.811231 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.811246 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.811357 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.811710 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.811713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.811722 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:19:55.811844 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.811850 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.812690 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.812693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.813698 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.813710 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.814183 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.814186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.814286 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.814343 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:19:55.815017 (+ 674us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:19:55.815033 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.815115 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.815202 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260807 15:19:55.821190 19252 raft_consensus.cc:1261] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Refusing update from remote peer dad846b93df943cfae4b429773a58d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:55.821302 19679 raft_consensus.cc:1261] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Refusing update from remote peer dad846b93df943cfae4b429773a58d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:55.821974 19816 consensus_queue.cc:1035] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:55.822252 19793 consensus_queue.cc:1035] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:55.825881 19794 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: TxnStatusTablet state changed. Reason: New leader dad846b93df943cfae4b429773a58d97. Latest consensus state: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.826018 19794 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:55.826629 19791 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: TxnStatusTablet state changed. Reason: New leader dad846b93df943cfae4b429773a58d97. Latest consensus state: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.826778 19791 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:55.829701 19793 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.829836 19793 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:19:55.829780 19816 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.829900 19816 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P dad846b93df943cfae4b429773a58d97: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:19:55.830560 19794 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.830690 19794 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P 669926f15bdf413493c5f97e056b8bb1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:55.831831 19791 tablet_replica.cc:439] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } } }
I20260807 15:19:55.831951 19791 tablet_replica.cc:442] T c18fc0ae64fd42cfae216939c7acd732 P 3e05df96bd3c489ca305b04fafa8c8e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:19:55.837316 19829 mvcc.cc:205] Tried to move back new op lower bound from 7315931118875975680 to 7315931118741635072. Current Snapshot: MvccSnapshot[applied={T|T < 7315931118875975680}]
I20260807 15:19:55.843566 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.838856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41226 (local address 127.15.242.193:43173)
0807 15:19:55.839004 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.839009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.839052 (+ 43us) server_negotiation.cc:407] Connection header received
0807 15:19:55.839273 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.839277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.839357 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.839476 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:55.839924 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.840751 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.841792 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.842148 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.842256 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.842569 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:55.843130 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:55.843246 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.843356 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.843421 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 15:19:55.857393 19843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.852649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:45365 (local address 127.15.242.193:54879)
0807 15:19:55.853011 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.853029 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.853164 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.853499 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.853501 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.853510 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:19:55.853643 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.853648 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.854761 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.854764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.855582 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.855593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.856323 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.856327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.856499 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.856563 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:19:55.857084 (+ 521us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:19:55.857095 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.857180 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.857253 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":156,"threads_started":1}
I20260807 15:19:55.857414 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.852836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:54879 (local address 127.15.242.194:45365)
0807 15:19:55.852982 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.852988 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.853144 (+ 156us) server_negotiation.cc:407] Connection header received
0807 15:19:55.853279 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.853282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.853339 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.853434 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:55.853819 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.854619 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.855705 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.856082 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.856194 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.856815 (+ 621us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:55.856905 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:55.856985 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.857218 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.857276 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 15:19:55.866529 19679 raft_consensus.cc:1261] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Refusing update from remote peer 669926f15bdf413493c5f97e056b8bb1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:55.866688 19459 raft_consensus.cc:1261] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Refusing update from remote peer 669926f15bdf413493c5f97e056b8bb1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:55.867342 19794 consensus_queue.cc:1035] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:55.867589 19797 consensus_queue.cc:1035] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:55.871444 19826 mvcc.cc:205] Tried to move back new op lower bound from 7315931119064576000 to 7315931117340016640. Current Snapshot: MvccSnapshot[applied={T|T < 7315931119064576000}]
I20260807 15:19:55.878423 19825 mvcc.cc:205] Tried to move back new op lower bound from 7315931119064576000 to 7315931117340016640. Current Snapshot: MvccSnapshot[applied={T|T < 7315931119064576000}]
I20260807 15:19:55.897023 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.888961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:43173 (local address 127.15.242.194:51149)
0807 15:19:55.893009 (+ 4048us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:55.893025 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:55.893191 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:55.893471 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:55.893474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:55.893485 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:19:55.893597 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.893603 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.894593 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.894597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.895556 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:55.895568 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.896079 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.896083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:55.896175 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.896227 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:19:55.896635 (+ 408us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:19:55.896644 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 15:19:55.896739 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 15:19:55.896851 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3895,"thread_start_us":99,"threads_started":1}
I20260807 15:19:55.897047 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:55.889077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:51149 (local address 127.15.242.193:43173)
0807 15:19:55.889242 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:55.889246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:55.893107 (+ 3861us) server_negotiation.cc:407] Connection header received
0807 15:19:55.893299 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:55.893303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:55.893360 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:55.893448 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:55.893721 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.894473 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.895693 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:55.895938 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:55.896035 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:55.896401 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:55.896518 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:55.896623 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:55.896803 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 15:19:55.896876 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 15:19:55.929932 19024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:55.930166 19024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:55.933277 19024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: Sending DeleteTablet for 3 replicas of tablet df8fe075251443a9a1e61b5cf199b131
I20260807 15:19:55.934343 19648 tablet_service.cc:1514] Processing DeleteTablet for tablet df8fe075251443a9a1e61b5cf199b131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:55 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:40980
I20260807 15:19:55.934477 19431 tablet_service.cc:1514] Processing DeleteTablet for tablet df8fe075251443a9a1e61b5cf199b131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:55 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:53486
I20260807 15:19:55.934978 19855 tablet_replica.cc:330] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: stopping tablet replica
I20260807 15:19:55.935012 19216 tablet_service.cc:1514] Processing DeleteTablet for tablet df8fe075251443a9a1e61b5cf199b131 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:55 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:41214
I20260807 15:19:55.935391 19855 raft_consensus.cc:2229] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:55.935772 19859 tablet_replica.cc:330] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: stopping tablet replica
I20260807 15:19:55.936138 19859 raft_consensus.cc:2229] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:19:55.936434 19855 raft_consensus.cc:2258] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:55.936627 19024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:19:55.937124 19024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:55.938385 19855 ts_tablet_manager.cc:1905] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:55.941987 19855 ts_tablet_manager.cc:1918] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:55.942215 19855 log.cc:1196] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/df8fe075251443a9a1e61b5cf199b131
I20260807 15:19:55.942699 19855 ts_tablet_manager.cc:1939] T df8fe075251443a9a1e61b5cf199b131 P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting consensus metadata
I20260807 15:19:55.943639 19648 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa45e9500974622a86c8068b8ba07c2 (DEFAULT_TABLE table=test-table [id=cf69e77b2039429091b48adc9b390dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:55.943907 19648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa45e9500974622a86c8068b8ba07c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.944229 19002 catalog_manager.cc:4841] TS 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083): tablet df8fe075251443a9a1e61b5cf199b131 (table test-table [id=16b18a121d25484e9fba50ba7cc8a382]) successfully deleted
I20260807 15:19:55.945590 19431 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa45e9500974622a86c8068b8ba07c2 (DEFAULT_TABLE table=test-table [id=cf69e77b2039429091b48adc9b390dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:55.945881 19431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa45e9500974622a86c8068b8ba07c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.948397 19786 tablet_bootstrap.cc:492] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: Bootstrap starting.
I20260807 15:19:55.949540 19786 tablet_bootstrap.cc:654] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.950366 19784 tablet_bootstrap.cc:492] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: Bootstrap starting.
I20260807 15:19:55.951259 19786 tablet_bootstrap.cc:492] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: No bootstrap required, opened a new log
I20260807 15:19:55.951377 19786 ts_tablet_manager.cc:1397] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 15:19:55.951385 19784 tablet_bootstrap.cc:654] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.951915 19786 raft_consensus.cc:348] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.952051 19786 raft_consensus.cc:374] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.952108 19786 raft_consensus.cc:729] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad846b93df943cfae4b429773a58d97, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.952257 19786 consensus_queue.cc:260] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.952576 19786 ts_tablet_manager.cc:1428] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:19:55.945482 19216 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa45e9500974622a86c8068b8ba07c2 (DEFAULT_TABLE table=test-table [id=cf69e77b2039429091b48adc9b390dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:55.953253 19216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa45e9500974622a86c8068b8ba07c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:55.955991 19857 tablet_replica.cc:330] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: stopping tablet replica
I20260807 15:19:55.956459 19859 raft_consensus.cc:2258] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:55.957047 19857 raft_consensus.cc:2229] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:55.957585 19857 raft_consensus.cc:2258] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:55.959273 19857 ts_tablet_manager.cc:1905] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:55.959303 19785 tablet_bootstrap.cc:492] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: Bootstrap starting.
I20260807 15:19:55.960371 19785 tablet_bootstrap.cc:654] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:55.962708 19784 tablet_bootstrap.cc:492] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: No bootstrap required, opened a new log
I20260807 15:19:55.962811 19784 ts_tablet_manager.cc:1397] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260807 15:19:55.963135 19857 ts_tablet_manager.cc:1918] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:55.963227 19857 log.cc:1196] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/df8fe075251443a9a1e61b5cf199b131
I20260807 15:19:55.963285 19784 raft_consensus.cc:348] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.963402 19784 raft_consensus.cc:374] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.963433 19784 raft_consensus.cc:729] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e05df96bd3c489ca305b04fafa8c8e6, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.963537 19857 ts_tablet_manager.cc:1939] T df8fe075251443a9a1e61b5cf199b131 P dad846b93df943cfae4b429773a58d97: Deleting consensus metadata
I20260807 15:19:55.963560 19784 consensus_queue.cc:260] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.964843 19001 catalog_manager.cc:4841] TS dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365): tablet df8fe075251443a9a1e61b5cf199b131 (table test-table [id=16b18a121d25484e9fba50ba7cc8a382]) successfully deleted
I20260807 15:19:55.965312 19784 ts_tablet_manager.cc:1428] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 15:19:55.965541 19785 tablet_bootstrap.cc:492] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: No bootstrap required, opened a new log
I20260807 15:19:55.965638 19785 ts_tablet_manager.cc:1397] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260807 15:19:55.966078 19785 raft_consensus.cc:348] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.966202 19785 raft_consensus.cc:374] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:55.966235 19785 raft_consensus.cc:729] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669926f15bdf413493c5f97e056b8bb1, State: Initialized, Role: FOLLOWER
I20260807 15:19:55.966357 19785 consensus_queue.cc:260] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:55.966638 19859 ts_tablet_manager.cc:1905] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:55.967454 19785 ts_tablet_manager.cc:1428] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 15:19:55.971074 19859 ts_tablet_manager.cc:1918] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:55.971226 19859 log.cc:1196] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/df8fe075251443a9a1e61b5cf199b131
I20260807 15:19:55.971549 19859 ts_tablet_manager.cc:1939] T df8fe075251443a9a1e61b5cf199b131 P 669926f15bdf413493c5f97e056b8bb1: Deleting consensus metadata
I20260807 15:19:55.972720 19001 catalog_manager.cc:4841] TS 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173): tablet df8fe075251443a9a1e61b5cf199b131 (table test-table [id=16b18a121d25484e9fba50ba7cc8a382]) successfully deleted
I20260807 15:19:56.143672 19836 raft_consensus.cc:482] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:56.143839 19836 raft_consensus.cc:504] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:56.144367 19836 leader_election.cc:288] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:56.145133 19252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa45e9500974622a86c8068b8ba07c2" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669926f15bdf413493c5f97e056b8bb1" is_pre_election: true
I20260807 15:19:56.145112 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa45e9500974622a86c8068b8ba07c2" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" is_pre_election: true
I20260807 15:19:56.145324 19252 raft_consensus.cc:2454] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 0.
I20260807 15:19:56.145335 19679 raft_consensus.cc:2454] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 0.
I20260807 15:19:56.145718 19358 leader_election.cc:302] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669926f15bdf413493c5f97e056b8bb1, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:56.145920 19836 raft_consensus.cc:2781] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:56.145996 19836 raft_consensus.cc:482] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:56.146051 19836 raft_consensus.cc:3037] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:56.147156 19836 raft_consensus.cc:504] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:56.147514 19836 leader_election.cc:288] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 election: Requested vote from peers 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:56.148043 19252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa45e9500974622a86c8068b8ba07c2" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669926f15bdf413493c5f97e056b8bb1"
I20260807 15:19:56.148218 19252 raft_consensus.cc:3037] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:56.149531 19252 raft_consensus.cc:2454] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 1.
I20260807 15:19:56.149806 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa45e9500974622a86c8068b8ba07c2" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6"
I20260807 15:19:56.149953 19358 leader_election.cc:302] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669926f15bdf413493c5f97e056b8bb1, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:56.149977 19679 raft_consensus.cc:3037] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:56.150148 19836 raft_consensus.cc:2781] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:56.150316 19836 raft_consensus.cc:686] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 1 LEADER]: Becoming Leader. State: Replica: dad846b93df943cfae4b429773a58d97, State: Running, Role: LEADER
I20260807 15:19:56.150478 19836 consensus_queue.cc:237] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:56.151207 19679 raft_consensus.cc:2454] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 1.
I20260807 15:19:56.152415 19024 catalog_manager.cc:5495] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 reported cstate change: term changed from 0 to 1, leader changed from <none> to dad846b93df943cfae4b429773a58d97 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } health_report { overall_health: UNKNOWN } } }
I20260807 15:19:56.168241 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:56.164936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53508 (local address 127.15.242.194:45365)
0807 15:19:56.165065 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:56.165069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:56.165186 (+ 117us) server_negotiation.cc:407] Connection header received
0807 15:19:56.165246 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:56.165249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:56.165301 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:56.165375 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:56.165738 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:56.166294 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:56.167182 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:56.167412 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:56.167500 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:56.167756 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:56.167828 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:56.167889 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:56.168063 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 15:19:56.168113 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 15:19:56.177853 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:56.174729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:45365 (local address 127.15.242.194:51005)
0807 15:19:56.174897 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:56.174914 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:19:56.175004 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:19:56.175273 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:19:56.175275 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:19:56.175281 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:19:56.175361 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:56.175365 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:56.176262 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:56.176265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:56.176858 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:19:56.176866 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:19:56.177292 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:19:56.177295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:19:56.177354 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:56.177380 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:19:56.177618 (+ 238us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:19:56.177623 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 15:19:56.177673 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 15:19:56.177742 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 15:19:56.177853 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:56.174861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:51005 (local address 127.15.242.194:45365)
0807 15:19:56.175007 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:56.175011 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:56.175026 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:19:56.175111 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:56.175116 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:56.175163 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:56.175228 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:56.175468 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:56.176126 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:56.176960 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:56.177180 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:56.177260 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:56.177481 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:56.177542 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:56.177595 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:56.177683 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 15:19:56.177722 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 15:19:56.183755 19252 raft_consensus.cc:1261] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Refusing update from remote peer dad846b93df943cfae4b429773a58d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:56.183785 19679 raft_consensus.cc:1261] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Refusing update from remote peer dad846b93df943cfae4b429773a58d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:56.184257 19793 consensus_queue.cc:1035] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:56.184430 19816 consensus_queue.cc:1035] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 15:19:56.200469 19847 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 15:19:57.760546 19022 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:57.760726 19022 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:57.763695 19022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: Sending DeleteTablet for 3 replicas of tablet 9fa45e9500974622a86c8068b8ba07c2
I20260807 15:19:57.764427 19648 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fa45e9500974622a86c8068b8ba07c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:57 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:40980
I20260807 15:19:57.764426 19431 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fa45e9500974622a86c8068b8ba07c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:57 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:53486
I20260807 15:19:57.764520 19216 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fa45e9500974622a86c8068b8ba07c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:57 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:41214
I20260807 15:19:57.764868 19896 tablet_replica.cc:330] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: stopping tablet replica
I20260807 15:19:57.764947 19901 tablet_replica.cc:330] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: stopping tablet replica
I20260807 15:19:57.765022 19896 raft_consensus.cc:2229] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:57.765123 19901 raft_consensus.cc:2229] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:57.765159 19896 raft_consensus.cc:2258] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:57.765272 19901 raft_consensus.cc:2258] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:57.765863 19901 ts_tablet_manager.cc:1905] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:57.765982 19896 ts_tablet_manager.cc:1905] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:57.769006 19901 ts_tablet_manager.cc:1918] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 15:19:57.769183 19901 log.cc:1196] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/9fa45e9500974622a86c8068b8ba07c2
I20260807 15:19:57.769485 19899 tablet_replica.cc:330] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: stopping tablet replica
I20260807 15:19:57.769615 19896 ts_tablet_manager.cc:1918] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 15:19:57.769590 19901 ts_tablet_manager.cc:1939] T 9fa45e9500974622a86c8068b8ba07c2 P 669926f15bdf413493c5f97e056b8bb1: Deleting consensus metadata
I20260807 15:19:57.769694 19899 raft_consensus.cc:2229] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:19:57.769805 19896 log.cc:1196] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/9fa45e9500974622a86c8068b8ba07c2
I20260807 15:19:57.770156 19899 raft_consensus.cc:2258] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:57.770226 19896 ts_tablet_manager.cc:1939] T 9fa45e9500974622a86c8068b8ba07c2 P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting consensus metadata
I20260807 15:19:57.770422 19001 catalog_manager.cc:4841] TS 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173): tablet 9fa45e9500974622a86c8068b8ba07c2 (table test-table [id=cf69e77b2039429091b48adc9b390dc5]) successfully deleted
I20260807 15:19:57.771144 19002 catalog_manager.cc:4841] TS 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083): tablet 9fa45e9500974622a86c8068b8ba07c2 (table test-table [id=cf69e77b2039429091b48adc9b390dc5]) successfully deleted
I20260807 15:19:57.771267 19899 ts_tablet_manager.cc:1905] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:57.774982 19899 ts_tablet_manager.cc:1918] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 15:19:57.775077 19899 log.cc:1196] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/9fa45e9500974622a86c8068b8ba07c2
I20260807 15:19:57.775352 19899 ts_tablet_manager.cc:1939] T 9fa45e9500974622a86c8068b8ba07c2 P dad846b93df943cfae4b429773a58d97: Deleting consensus metadata
I20260807 15:19:57.776068 19001 catalog_manager.cc:4841] TS dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365): tablet 9fa45e9500974622a86c8068b8ba07c2 (table test-table [id=cf69e77b2039429091b48adc9b390dc5]) successfully deleted
Aug 07 15:19:57 dist-test-slave-g170 krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115997, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 15:19:57 dist-test-slave-g170 krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786115997, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:19:57.797392 19916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:57.787464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42560 (local address 127.15.242.254:45653)
0807 15:19:57.787749 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:57.787757 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:57.787774 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:19:57.787932 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:57.787935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:57.787986 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:57.788079 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:19:57.788897 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:57.789493 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:57.790356 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:57.790598 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:57.790697 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:57.793730 (+ 3033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:19:57.793733 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:19:57.793735 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:19:57.793760 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:19:57.795623 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:57.796073 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:57.796077 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:57.796078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:57.796186 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:19:57.796463 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:19:57.796466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:19:57.796467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:19:57.796663 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:19:57.796872 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:57.797128 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 15:19:57.797257 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":111,"threads_started":1}
I20260807 15:19:57.800383 19022 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42560:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:19:57.801081 19022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:57.806329 19216 tablet_service.cc:1467] Processing CreateTablet for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c (DEFAULT_TABLE table=test-table [id=9aa0bce3644c47078f9e16fbe6c42843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:57.806488 19431 tablet_service.cc:1467] Processing CreateTablet for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c (DEFAULT_TABLE table=test-table [id=9aa0bce3644c47078f9e16fbe6c42843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:57.806654 19216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:57.806613 19648 tablet_service.cc:1467] Processing CreateTablet for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c (DEFAULT_TABLE table=test-table [id=9aa0bce3644c47078f9e16fbe6c42843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:57.806777 19431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:57.806895 19648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:57.809926 19919 tablet_bootstrap.cc:492] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: Bootstrap starting.
I20260807 15:19:57.810109 19920 tablet_bootstrap.cc:492] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: Bootstrap starting.
I20260807 15:19:57.811149 19920 tablet_bootstrap.cc:654] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:57.811368 19919 tablet_bootstrap.cc:654] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:57.812459 19920 tablet_bootstrap.cc:492] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: No bootstrap required, opened a new log
I20260807 15:19:57.812630 19920 ts_tablet_manager.cc:1397] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:57.812870 19919 tablet_bootstrap.cc:492] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: No bootstrap required, opened a new log
I20260807 15:19:57.812961 19919 ts_tablet_manager.cc:1397] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:57.813311 19920 raft_consensus.cc:348] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.813437 19920 raft_consensus.cc:374] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:57.813474 19920 raft_consensus.cc:729] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669926f15bdf413493c5f97e056b8bb1, State: Initialized, Role: FOLLOWER
I20260807 15:19:57.813396 19919 raft_consensus.cc:348] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.813524 19919 raft_consensus.cc:374] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:57.813563 19919 raft_consensus.cc:729] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e05df96bd3c489ca305b04fafa8c8e6, State: Initialized, Role: FOLLOWER
I20260807 15:19:57.813649 19920 consensus_queue.cc:260] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.813688 19919 consensus_queue.cc:260] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.814054 19919 ts_tablet_manager.cc:1428] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:19:57.814054 19920 ts_tablet_manager.cc:1428] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:19:57.814445 19918 tablet_bootstrap.cc:492] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: Bootstrap starting.
I20260807 15:19:57.815495 19918 tablet_bootstrap.cc:654] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:57.817112 19918 tablet_bootstrap.cc:492] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: No bootstrap required, opened a new log
I20260807 15:19:57.817191 19918 ts_tablet_manager.cc:1397] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:57.817602 19918 raft_consensus.cc:348] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.817708 19918 raft_consensus.cc:374] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:57.817734 19918 raft_consensus.cc:729] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad846b93df943cfae4b429773a58d97, State: Initialized, Role: FOLLOWER
I20260807 15:19:57.817874 19918 consensus_queue.cc:260] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.818173 19918 ts_tablet_manager.cc:1428] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 15:19:57.926303 19924 raft_consensus.cc:482] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:57.926479 19924 raft_consensus.cc:504] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.926955 19924 leader_election.cc:288] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:57.927601 19459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfdf3b84fdb4bfbafaab746aa5a1c3c" candidate_uuid: "669926f15bdf413493c5f97e056b8bb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dad846b93df943cfae4b429773a58d97" is_pre_election: true
I20260807 15:19:57.927719 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfdf3b84fdb4bfbafaab746aa5a1c3c" candidate_uuid: "669926f15bdf413493c5f97e056b8bb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" is_pre_election: true
I20260807 15:19:57.927873 19679 raft_consensus.cc:2454] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669926f15bdf413493c5f97e056b8bb1 in term 0.
I20260807 15:19:57.927861 19459 raft_consensus.cc:2454] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669926f15bdf413493c5f97e056b8bb1 in term 0.
I20260807 15:19:57.928310 19149 leader_election.cc:302] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669926f15bdf413493c5f97e056b8bb1, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:57.928548 19924 raft_consensus.cc:2781] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:57.928611 19924 raft_consensus.cc:482] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:57.928639 19924 raft_consensus.cc:3037] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:57.929809 19924 raft_consensus.cc:504] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.930171 19924 leader_election.cc:288] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [CANDIDATE]: Term 1 election: Requested vote from peers dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:57.930616 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfdf3b84fdb4bfbafaab746aa5a1c3c" candidate_uuid: "669926f15bdf413493c5f97e056b8bb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6"
I20260807 15:19:57.930616 19459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfdf3b84fdb4bfbafaab746aa5a1c3c" candidate_uuid: "669926f15bdf413493c5f97e056b8bb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dad846b93df943cfae4b429773a58d97"
I20260807 15:19:57.930760 19679 raft_consensus.cc:3037] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:57.930784 19459 raft_consensus.cc:3037] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:57.932011 19679 raft_consensus.cc:2454] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669926f15bdf413493c5f97e056b8bb1 in term 1.
I20260807 15:19:57.932011 19459 raft_consensus.cc:2454] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669926f15bdf413493c5f97e056b8bb1 in term 1.
I20260807 15:19:57.932343 19149 leader_election.cc:302] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669926f15bdf413493c5f97e056b8bb1, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:57.932545 19924 raft_consensus.cc:2781] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:57.932842 19924 raft_consensus.cc:686] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 1 LEADER]: Becoming Leader. State: Replica: 669926f15bdf413493c5f97e056b8bb1, State: Running, Role: LEADER
I20260807 15:19:57.933033 19924 consensus_queue.cc:237] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:57.934994 19024 catalog_manager.cc:5495] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "669926f15bdf413493c5f97e056b8bb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } health_report { overall_health: UNKNOWN } } }
I20260807 15:19:57.979360 19930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:57.975262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50946 (local address 127.15.242.193:43173)
0807 15:19:57.975580 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:57.975588 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:57.975601 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:19:57.975647 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:57.975649 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:57.975776 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:57.975877 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:57.976249 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:57.976928 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:57.977920 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:57.978149 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:57.978233 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:57.978720 (+ 487us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:57.978828 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:57.978918 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:57.979088 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 15:19:57.979160 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":166,"threads_started":1}
I20260807 15:19:57.986975 19679 raft_consensus.cc:1261] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Refusing update from remote peer 669926f15bdf413493c5f97e056b8bb1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:57.987360 19459 raft_consensus.cc:1261] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Refusing update from remote peer 669926f15bdf413493c5f97e056b8bb1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:57.987470 19926 consensus_queue.cc:1035] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:57.987861 19926 consensus_queue.cc:1035] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:58.021859 19022 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:58.022073 19022 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:58.024292 19022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: Sending DeleteTablet for 3 replicas of tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c
I20260807 15:19:58.024945 19216 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:58 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:41214
I20260807 15:19:58.025007 19431 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:58 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:53486
I20260807 15:19:58.025063 19648 tablet_service.cc:1514] Processing DeleteTablet for tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:58 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:40980
I20260807 15:19:58.025187 19901 tablet_replica.cc:330] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: stopping tablet replica
I20260807 15:19:58.025231 19899 tablet_replica.cc:330] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: stopping tablet replica
I20260807 15:19:58.025339 19896 tablet_replica.cc:330] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: stopping tablet replica
I20260807 15:19:58.025359 19899 raft_consensus.cc:2229] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:58.025352 19901 raft_consensus.cc:2229] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:19:58.025457 19899 raft_consensus.cc:2258] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:58.025460 19896 raft_consensus.cc:2229] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:58.025557 19901 raft_consensus.cc:2258] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:58.025576 19896 raft_consensus.cc:2258] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:58.026417 19896 ts_tablet_manager.cc:1905] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:58.026479 19899 ts_tablet_manager.cc:1905] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:58.026912 19022 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42560:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:19:58.027354 19022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:19:58.029155 19899 ts_tablet_manager.cc:1918] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:58.029400 19896 ts_tablet_manager.cc:1918] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:58.029486 19896 log.cc:1196] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/8bfdf3b84fdb4bfbafaab746aa5a1c3c
I20260807 15:19:58.029870 19896 ts_tablet_manager.cc:1939] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting consensus metadata
I20260807 15:19:58.029920 19899 log.cc:1196] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/8bfdf3b84fdb4bfbafaab746aa5a1c3c
I20260807 15:19:58.030253 19899 ts_tablet_manager.cc:1939] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P dad846b93df943cfae4b429773a58d97: Deleting consensus metadata
I20260807 15:19:58.030311 19901 ts_tablet_manager.cc:1905] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:58.030664 19002 catalog_manager.cc:4841] TS 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083): tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c (table test-table [id=9aa0bce3644c47078f9e16fbe6c42843]) successfully deleted
I20260807 15:19:58.031030 19001 catalog_manager.cc:4841] TS dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365): tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c (table test-table [id=9aa0bce3644c47078f9e16fbe6c42843]) successfully deleted
I20260807 15:19:58.032575 19901 ts_tablet_manager.cc:1918] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:19:58.032634 19901 log.cc:1196] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/8bfdf3b84fdb4bfbafaab746aa5a1c3c
I20260807 15:19:58.032949 19901 ts_tablet_manager.cc:1939] T 8bfdf3b84fdb4bfbafaab746aa5a1c3c P 669926f15bdf413493c5f97e056b8bb1: Deleting consensus metadata
I20260807 15:19:58.033715 19001 catalog_manager.cc:4841] TS 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173): tablet 8bfdf3b84fdb4bfbafaab746aa5a1c3c (table test-table [id=9aa0bce3644c47078f9e16fbe6c42843]) successfully deleted
I20260807 15:19:58.035858 19216 tablet_service.cc:1467] Processing CreateTablet for tablet 584f7bfb885b435f9eb08a9ebea5ffeb (DEFAULT_TABLE table=test-table [id=db13247fe2ae4faebc820ee46c0d87cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:58.036095 19216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584f7bfb885b435f9eb08a9ebea5ffeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:58.036052 19648 tablet_service.cc:1467] Processing CreateTablet for tablet 584f7bfb885b435f9eb08a9ebea5ffeb (DEFAULT_TABLE table=test-table [id=db13247fe2ae4faebc820ee46c0d87cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:58.036352 19648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584f7bfb885b435f9eb08a9ebea5ffeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:58.038084 19920 tablet_bootstrap.cc:492] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1: Bootstrap starting.
I20260807 15:19:58.038298 19431 tablet_service.cc:1467] Processing CreateTablet for tablet 584f7bfb885b435f9eb08a9ebea5ffeb (DEFAULT_TABLE table=test-table [id=db13247fe2ae4faebc820ee46c0d87cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:19:58.038676 19431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584f7bfb885b435f9eb08a9ebea5ffeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:19:58.038686 19919 tablet_bootstrap.cc:492] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: Bootstrap starting.
I20260807 15:19:58.039072 19920 tablet_bootstrap.cc:654] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:58.039746 19919 tablet_bootstrap.cc:654] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:58.040443 19920 tablet_bootstrap.cc:492] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1: No bootstrap required, opened a new log
I20260807 15:19:58.040560 19920 ts_tablet_manager.cc:1397] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:58.041042 19920 raft_consensus.cc:348] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.041144 19919 tablet_bootstrap.cc:492] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: No bootstrap required, opened a new log
I20260807 15:19:58.041183 19920 raft_consensus.cc:374] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:58.041229 19919 ts_tablet_manager.cc:1397] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:19:58.041234 19920 raft_consensus.cc:729] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669926f15bdf413493c5f97e056b8bb1, State: Initialized, Role: FOLLOWER
I20260807 15:19:58.041342 19918 tablet_bootstrap.cc:492] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: Bootstrap starting.
I20260807 15:19:58.041440 19920 consensus_queue.cc:260] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.041725 19920 ts_tablet_manager.cc:1428] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 15:19:58.041738 19919 raft_consensus.cc:348] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.041870 19919 raft_consensus.cc:374] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:58.041909 19919 raft_consensus.cc:729] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e05df96bd3c489ca305b04fafa8c8e6, State: Initialized, Role: FOLLOWER
I20260807 15:19:58.042038 19919 consensus_queue.cc:260] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.042260 19918 tablet_bootstrap.cc:654] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: Neither blocks nor log segments found. Creating new log.
I20260807 15:19:58.043560 19918 tablet_bootstrap.cc:492] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: No bootstrap required, opened a new log
I20260807 15:19:58.043690 19918 ts_tablet_manager.cc:1397] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 15:19:58.043696 19919 ts_tablet_manager.cc:1428] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260807 15:19:58.044173 19918 raft_consensus.cc:348] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.044302 19918 raft_consensus.cc:374] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:19:58.044339 19918 raft_consensus.cc:729] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dad846b93df943cfae4b429773a58d97, State: Initialized, Role: FOLLOWER
I20260807 15:19:58.044467 19918 consensus_queue.cc:260] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.044915 19918 ts_tablet_manager.cc:1428] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260807 15:19:58.127307 19876 raft_consensus.cc:482] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:19:58.127499 19876 raft_consensus.cc:504] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.128064 19876 leader_election.cc:288] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:58.128583 19252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584f7bfb885b435f9eb08a9ebea5ffeb" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669926f15bdf413493c5f97e056b8bb1" is_pre_election: true
I20260807 15:19:58.128633 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584f7bfb885b435f9eb08a9ebea5ffeb" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" is_pre_election: true
I20260807 15:19:58.128834 19679 raft_consensus.cc:2454] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 0.
I20260807 15:19:58.128844 19252 raft_consensus.cc:2454] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 0.
I20260807 15:19:58.129211 19361 leader_election.cc:302] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e05df96bd3c489ca305b04fafa8c8e6, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:58.129431 19876 raft_consensus.cc:2781] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:19:58.129540 19876 raft_consensus.cc:482] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:19:58.129590 19876 raft_consensus.cc:3037] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:58.130690 19876 raft_consensus.cc:504] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.131034 19876 leader_election.cc:288] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 election: Requested vote from peers 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173), 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083)
I20260807 15:19:58.131409 19252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584f7bfb885b435f9eb08a9ebea5ffeb" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669926f15bdf413493c5f97e056b8bb1"
I20260807 15:19:58.131528 19252 raft_consensus.cc:3037] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:58.131515 19679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584f7bfb885b435f9eb08a9ebea5ffeb" candidate_uuid: "dad846b93df943cfae4b429773a58d97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e05df96bd3c489ca305b04fafa8c8e6"
I20260807 15:19:58.131664 19679 raft_consensus.cc:3037] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:19:58.132597 19252 raft_consensus.cc:2454] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 1.
I20260807 15:19:58.132853 19679 raft_consensus.cc:2454] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dad846b93df943cfae4b429773a58d97 in term 1.
I20260807 15:19:58.132948 19358 leader_election.cc:302] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669926f15bdf413493c5f97e056b8bb1, dad846b93df943cfae4b429773a58d97; no voters:
I20260807 15:19:58.133141 19876 raft_consensus.cc:2781] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:19:58.133268 19876 raft_consensus.cc:686] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 1 LEADER]: Becoming Leader. State: Replica: dad846b93df943cfae4b429773a58d97, State: Running, Role: LEADER
I20260807 15:19:58.133448 19876 consensus_queue.cc:237] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } }
I20260807 15:19:58.135273 19022 catalog_manager.cc:5495] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 reported cstate change: term changed from 0 to 1, leader changed from <none> to dad846b93df943cfae4b429773a58d97 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "dad846b93df943cfae4b429773a58d97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dad846b93df943cfae4b429773a58d97" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 } health_report { overall_health: UNKNOWN } } }
I20260807 15:19:58.151656 19947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:58.148157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39316 (local address 127.15.242.194:45365)
0807 15:19:58.148492 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0807 15:19:58.148501 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 15:19:58.148513 (+ 12us) server_negotiation.cc:407] Connection header received
0807 15:19:58.148554 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:19:58.148556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:19:58.148600 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:19:58.148680 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:19:58.148996 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:58.149596 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:58.150391 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:19:58.150627 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:19:58.150710 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:19:58.151104 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:19:58.151183 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:19:58.151259 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 15:19:58.151404 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 15:19:58.151452 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":161,"threads_started":1}
I20260807 15:19:58.158582 19679 raft_consensus.cc:1261] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Refusing update from remote peer dad846b93df943cfae4b429773a58d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:58.158640 19252 raft_consensus.cc:1261] T 584f7bfb885b435f9eb08a9ebea5ffeb P 669926f15bdf413493c5f97e056b8bb1 [term 1 FOLLOWER]: Refusing update from remote peer dad846b93df943cfae4b429773a58d97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:19:58.159013 19816 consensus_queue.cc:1035] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e05df96bd3c489ca305b04fafa8c8e6" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:19:58.159197 19891 consensus_queue.cc:1035] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669926f15bdf413493c5f97e056b8bb1" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 15:19:58.173578 19873 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 15:19:59.725627 19022 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:59.725817 19022 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:19:59.728399 19022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7073f142d4bc4e53a373b52b98cd7ace: Sending DeleteTablet for 3 replicas of tablet 584f7bfb885b435f9eb08a9ebea5ffeb
I20260807 15:19:59.729111 19216 tablet_service.cc:1514] Processing DeleteTablet for tablet 584f7bfb885b435f9eb08a9ebea5ffeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:59 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:41214
I20260807 15:19:59.729167 19431 tablet_service.cc:1514] Processing DeleteTablet for tablet 584f7bfb885b435f9eb08a9ebea5ffeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:59 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:53486
I20260807 15:19:59.729264 19648 tablet_service.cc:1514] Processing DeleteTablet for tablet 584f7bfb885b435f9eb08a9ebea5ffeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:19:59 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:40980
I20260807 15:19:59.729717 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 19125
I20260807 15:19:59.729773 19994 tablet_replica.cc:330] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: stopping tablet replica
I20260807 15:19:59.729790 19995 tablet_replica.cc:330] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: stopping tablet replica
I20260807 15:19:59.738044 19995 raft_consensus.cc:2229] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:19:59.738232 19995 raft_consensus.cc:2258] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:59.738884 19994 raft_consensus.cc:2229] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:19:59.739131 19995 ts_tablet_manager.cc:1905] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:59.739153 19994 raft_consensus.cc:2258] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:19:59.739884 19994 ts_tablet_manager.cc:1905] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:19:59.742398 19994 ts_tablet_manager.cc:1918] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 15:19:59.742503 19994 log.cc:1196] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/584f7bfb885b435f9eb08a9ebea5ffeb
I20260807 15:19:59.742830 19995 ts_tablet_manager.cc:1918] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 15:19:59.742923 19995 log.cc:1196] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/584f7bfb885b435f9eb08a9ebea5ffeb
I20260807 15:19:59.742920 19994 ts_tablet_manager.cc:1939] T 584f7bfb885b435f9eb08a9ebea5ffeb P dad846b93df943cfae4b429773a58d97: Deleting consensus metadata
I20260807 15:19:59.743294 19995 ts_tablet_manager.cc:1939] T 584f7bfb885b435f9eb08a9ebea5ffeb P 3e05df96bd3c489ca305b04fafa8c8e6: Deleting consensus metadata
I20260807 15:19:59.743750 19001 catalog_manager.cc:4841] TS dad846b93df943cfae4b429773a58d97 (127.15.242.194:45365): tablet 584f7bfb885b435f9eb08a9ebea5ffeb (table test-table [id=db13247fe2ae4faebc820ee46c0d87cd]) successfully deleted
I20260807 15:19:59.744093 19002 catalog_manager.cc:4841] TS 3e05df96bd3c489ca305b04fafa8c8e6 (127.15.242.195:41083): tablet 584f7bfb885b435f9eb08a9ebea5ffeb (table test-table [id=db13247fe2ae4faebc820ee46c0d87cd]) successfully deleted
W20260807 15:19:59.747853 19001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:43173 (error 108)
I20260807 15:19:59.748869 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 19338
I20260807 15:19:59.749068 19998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:19:59.748597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:43173 (local address 127.0.0.1:50960)
0807 15:19:59.748866 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 15:19:59.748935 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:43173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":85,"threads_started":1}
W20260807 15:19:59.754940 19001 catalog_manager.cc:4584] TS 669926f15bdf413493c5f97e056b8bb1 (127.15.242.193:43173): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 584f7bfb885b435f9eb08a9ebea5ffeb: Network error: Client connection negotiation failed: client connection to 127.15.242.193:43173: connect: Connection refused (error 111)
I20260807 15:19:59.768043 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 19540
I20260807 15:19:59.781755 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18968
2026-08-07T15:19:59Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6923 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:19:59 dist-test-slave-g170 krb5kdc[20002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:19:59 dist-test-slave-g170 krb5kdc[20002](info): set up 2 sockets
Aug 07 15:19:59 dist-test-slave-g170 krb5kdc[20002](info): commencing operation
krb5kdc: starting...
W20260807 15:20:01.143563 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:01 dist-test-slave-g170 krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:01.276046 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:40075
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:40075
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:01.395473 20018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:01.395804 20018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:01.395896 20018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:01.399993 20018 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:01.400104 20018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:01.400156 20018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:01.400198 20018 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:01.400238 20018 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:01.405659 20018 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:40075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:40075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:01.406766 20018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:01.407855 20018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:01.417279 20023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:01.417344 20018 server_base.cc:1034] running on GCE node
W20260807 15:20:01.417338 20024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:01.417307 20026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:01.418068 20018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:01.419224 20018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:01.420439 20018 hybrid_clock.cc:648] HybridClock initialized: now 1786116001420417 us; error 36 us; skew 500 ppm
Aug 07 15:20:01 dist-test-slave-g170 krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116001, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:01.423382 20018 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:01.424345 20018 webserver.cc:460] Webserver started at http://127.15.242.254:45193/ using document root <none> and password file <none>
I20260807 15:20:01.425061 20018 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:01.425169 20018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:01.425419 20018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:01.427511 20018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "1049bba27ddc458896c1dcae20614bb3"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "158e3845dc3f7a63c6365fbdbf38b6dc"
server_key_iv: "43b796b7dc8c63b68fa96d0b82a9149c"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.428085 20018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "1049bba27ddc458896c1dcae20614bb3"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "158e3845dc3f7a63c6365fbdbf38b6dc"
server_key_iv: "43b796b7dc8c63b68fa96d0b82a9149c"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.431934 20018 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:20:01.434508 20035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:01.435810 20018 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:01.435950 20018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "1049bba27ddc458896c1dcae20614bb3"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "158e3845dc3f7a63c6365fbdbf38b6dc"
server_key_iv: "43b796b7dc8c63b68fa96d0b82a9149c"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.436061 20018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:01.452121 20018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:01.455600 20018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:01.455852 20018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:01.463416 20018 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:40075
I20260807 15:20:01.463434 20127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:40075 every 8 connection(s)
I20260807 15:20:01.464406 20018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:01.467257 20128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:01.472751 20128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3: Bootstrap starting.
I20260807 15:20:01.473304 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 20018
I20260807 15:20:01.473409 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:01.473683 16331 external_mini_cluster.cc:1428] Setting key 3fa4126ff6155049ec1c759795129cf6
I20260807 15:20:01.475561 20128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:01.476297 20128 log.cc:824] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:01.478442 20128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3: No bootstrap required, opened a new log
Aug 07 15:20:01 dist-test-slave-g170 krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:01.483018 20128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1049bba27ddc458896c1dcae20614bb3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 40075 } }
I20260807 15:20:01.483232 20128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:01.483304 20128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1049bba27ddc458896c1dcae20614bb3, State: Initialized, Role: FOLLOWER
I20260807 15:20:01.483760 20128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1049bba27ddc458896c1dcae20614bb3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 40075 } }
I20260807 15:20:01.483952 20128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:01.484031 20128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:01.484145 20128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:01.485275 20128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1049bba27ddc458896c1dcae20614bb3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 40075 } }
I20260807 15:20:01.485819 20128 leader_election.cc:302] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1049bba27ddc458896c1dcae20614bb3; no voters:
I20260807 15:20:01.486225 20128 leader_election.cc:288] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:01.486294 20140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:01.486526 20140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [term 1 LEADER]: Becoming Leader. State: Replica: 1049bba27ddc458896c1dcae20614bb3, State: Running, Role: LEADER
I20260807 15:20:01.486944 20140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1049bba27ddc458896c1dcae20614bb3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 40075 } }
I20260807 15:20:01.487627 20128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:01.488729 20144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1049bba27ddc458896c1dcae20614bb3. Latest consensus state: current_term: 1 leader_uuid: "1049bba27ddc458896c1dcae20614bb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1049bba27ddc458896c1dcae20614bb3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 40075 } } }
I20260807 15:20:01.488897 20144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:01.489019 20135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:01.474987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40398 (local address 127.15.242.254:40075)
0807 15:20:01.475424 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:01.475440 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:01.475476 (+ 36us) server_negotiation.cc:407] Connection header received
0807 15:20:01.476162 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:01.476179 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:01.476554 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:01.476962 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:01.477785 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:01.478808 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:01.479994 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:01.480461 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:01.480581 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:01.483491 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:01.483496 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:01.483509 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:01.483536 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:01.485499 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:01.485961 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:01.485968 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:01.485974 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:01.486104 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:01.486458 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:01.486461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:01.486462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:01.487012 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:01.487250 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:01.487673 (+ 423us) server_negotiation.cc:299] Negotiation successful
0807 15:20:01.487990 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":147,"threads_started":1}
I20260807 15:20:01.489248 20142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1049bba27ddc458896c1dcae20614bb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1049bba27ddc458896c1dcae20614bb3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 40075 } } }
I20260807 15:20:01.489331 20142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3 [sys.catalog]: This master's current role is: LEADER
W20260807 15:20:01.493319 20166 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:20:01.493402 20166 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:20:01.493512 20155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:01.494267 20155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:01.500379 20155 catalog_manager.cc:1347] Generated new cluster ID: 4ab449b6674a442eb40de177ae5d8c29
I20260807 15:20:01.500458 20155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:01.506743 20155 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:01.508040 20155 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:01.525360 20155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1049bba27ddc458896c1dcae20614bb3: Generated new TSK 0
I20260807 15:20:01.526291 20155 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:20:01.566136 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:40075
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:01.689745 20175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:01.690028 20175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:01.690101 20175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:01.694199 20175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:01.694288 20175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:01.694377 20175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:01.699528 20175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:40075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:01.700578 20175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:01.701678 20175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:01.712198 20189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:01.712203 20191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:01.712306 20188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:01.712388 20175 server_base.cc:1034] running on GCE node
I20260807 15:20:01.712981 20175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:01.713649 20175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:01.714839 20175 hybrid_clock.cc:648] HybridClock initialized: now 1786116001714820 us; error 31 us; skew 500 ppm
Aug 07 15:20:01 dist-test-slave-g170 krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116001, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:01.717849 20175 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:20:01.718742 20175 webserver.cc:460] Webserver started at http://127.15.242.193:33407/ using document root <none> and password file <none>
I20260807 15:20:01.719355 20175 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:01.719458 20175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:01.719705 20175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:01.721894 20175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "de9f2e53261a4bf3a4163bb1321ce4e5"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "9257117e4e5b75508ece1a8c8ffa1fc2"
server_key_iv: "5a193fdeee0ec4f50b3ee8a65ed2acd1"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.722491 20175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "de9f2e53261a4bf3a4163bb1321ce4e5"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "9257117e4e5b75508ece1a8c8ffa1fc2"
server_key_iv: "5a193fdeee0ec4f50b3ee8a65ed2acd1"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.726519 20175 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:01.729212 20205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:01.730477 20175 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 15:20:01.730620 20175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "de9f2e53261a4bf3a4163bb1321ce4e5"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "9257117e4e5b75508ece1a8c8ffa1fc2"
server_key_iv: "5a193fdeee0ec4f50b3ee8a65ed2acd1"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.730738 20175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:01.746289 20175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:01.749693 20175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:01.749923 20175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:01.750571 20175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:01.751484 20175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:01.751559 20175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:01.751634 20175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:01.751679 20175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:01.761750 20175 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:44895
I20260807 15:20:01.761795 20394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:44895 every 8 connection(s)
I20260807 15:20:01.762737 20175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:01.764261 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 20175
I20260807 15:20:01.764384 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:01.764719 16331 external_mini_cluster.cc:1428] Setting key b87d3b5464715f7aa4e430a6a5d035e8
Aug 07 15:20:01 dist-test-slave-g170 krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116001, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:20:01.777833 20135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:01.764862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:48443 (local address 127.15.242.254:40075)
0807 15:20:01.765014 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:01.765024 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:01.766299 (+ 1275us) server_negotiation.cc:407] Connection header received
0807 15:20:01.767272 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:01.767279 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:01.767343 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:01.767447 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:01.768727 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:01.769314 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:01.770509 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:01.770926 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:01.771053 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:01.773766 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:01.773772 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:01.773779 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:01.773816 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:01.775589 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:01.776156 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:01.776163 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:01.776167 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:01.776272 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:01.776624 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:01.776627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:01.776629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:01.776940 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:01.777058 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:01.777583 (+ 525us) server_negotiation.cc:299] Negotiation successful
0807 15:20:01.777702 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 15:20:01.778806 20398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:01.765320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:40075 (local address 127.15.242.193:48443)
0807 15:20:01.766092 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:01.766185 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:01.767032 (+ 847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:01.767630 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:01.767637 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:01.768009 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:01.768573 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:01.768588 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:01.769449 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:01.769452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:01.770351 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:01.770361 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:01.771103 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:01.771107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:01.771271 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:01.771910 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:01.771927 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:01.773576 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:01.775729 (+ 2153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:01.775734 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:01.775748 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:01.776046 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:01.776382 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:01.776384 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:01.776386 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:01.776525 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:01.777072 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:01.777078 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:01.777348 (+ 270us) client_negotiation.cc:769] Sending connection context
0807 15:20:01.777519 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 15:20:01.777793 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":122,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:20:01.780103 20395 heartbeater.cc:347] Connected to a master server at 127.15.242.254:40075
I20260807 15:20:01.780397 20395 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:01.781085 20395 heartbeater.cc:511] Master 127.15.242.254:40075 requested a full tablet report, sending...
I20260807 15:20:01.783087 20067 ts_manager.cc:194] Registered new tserver with Master: de9f2e53261a4bf3a4163bb1321ce4e5 (127.15.242.193:44895)
I20260807 15:20:01.784875 20067 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:48443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:20:01.799573 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:40075
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:01.917794 20401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:01.918049 20401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:01.918092 20401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:01.922194 20401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:01.922254 20401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:01.922313 20401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:01.927968 20401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:40075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:01.929093 20401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:01.930166 20401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:01.940550 20412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:01.940550 20410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:01.941286 20401 server_base.cc:1034] running on GCE node
W20260807 15:20:01.941352 20409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:01.941951 20401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:01.942819 20401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:01.944032 20401 hybrid_clock.cc:648] HybridClock initialized: now 1786116001944021 us; error 48 us; skew 500 ppm
Aug 07 15:20:01 dist-test-slave-g170 krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116001, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:01.947597 20401 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:20:01.948486 20401 webserver.cc:460] Webserver started at http://127.15.242.194:42947/ using document root <none> and password file <none>
I20260807 15:20:01.949088 20401 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:01.949158 20401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:01.949333 20401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:01.951395 20401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "07026934cb7541cf8da3245f034eb274"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "797d3c87463c1fded9d0d7570558e639"
server_key_iv: "da2366328b5e57cb990a028c46dd97ad"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.951920 20401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "07026934cb7541cf8da3245f034eb274"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "797d3c87463c1fded9d0d7570558e639"
server_key_iv: "da2366328b5e57cb990a028c46dd97ad"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.955838 20401 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 15:20:01.958581 20421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:01.959908 20401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:20:01.960011 20401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "07026934cb7541cf8da3245f034eb274"
format_stamp: "Formatted at 2026-08-07 15:20:01 on dist-test-slave-g170"
server_key: "797d3c87463c1fded9d0d7570558e639"
server_key_iv: "da2366328b5e57cb990a028c46dd97ad"
server_key_version: "encryptionkey@0"
I20260807 15:20:01.960098 20401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:01.989507 20401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:01.993075 20401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:01.993244 20401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:01.993888 20401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:01.994735 20401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:01.994783 20401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:01.994825 20401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:01.994840 20401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:02.004256 20401 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:34331
I20260807 15:20:02.004278 20603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:34331 every 8 connection(s)
I20260807 15:20:02.005263 20401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:02.007093 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 20401
I20260807 15:20:02.007238 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:02.007586 16331 external_mini_cluster.cc:1428] Setting key 535716ad6c1635f4f3fafd7d2f72cc13
Aug 07 15:20:02 dist-test-slave-g170 krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116001, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:20:02.021535 20135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:02.007419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:53795 (local address 127.15.242.254:40075)
0807 15:20:02.007593 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:02.007599 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:02.008630 (+ 1031us) server_negotiation.cc:407] Connection header received
0807 15:20:02.009949 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:02.009952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:02.009998 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:02.010072 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:02.011857 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:02.012394 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:02.013795 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:02.014022 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:02.014144 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:02.017163 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:02.017167 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:02.017169 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:02.017204 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:02.018869 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:02.019626 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:02.019634 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:02.019635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:02.019729 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:02.020131 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:02.020134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:02.020135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:02.020407 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:02.020527 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:02.021163 (+ 636us) server_negotiation.cc:299] Negotiation successful
0807 15:20:02.021330 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:20:02.022571 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:02.007694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:40075 (local address 127.15.242.194:53795)
0807 15:20:02.008481 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:02.008527 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:02.009690 (+ 1163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:02.010306 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:02.010318 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:02.010912 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:02.011668 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:02.011694 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:02.012535 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:02.012539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:02.013618 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:02.013630 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:02.014196 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:02.014200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:02.014396 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:02.015037 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:02.015055 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:02.016913 (+ 1858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:02.019014 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:02.019022 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:02.019042 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:02.019496 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:02.019832 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:02.019835 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:02.019837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:02.019998 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:02.020529 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:02.020537 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:02.020891 (+ 354us) client_negotiation.cc:769] Sending connection context
0807 15:20:02.021103 (+ 212us) client_negotiation.cc:240] Negotiation successful
0807 15:20:02.021505 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":134,"threads_started":1}
I20260807 15:20:02.024017 20604 heartbeater.cc:347] Connected to a master server at 127.15.242.254:40075
I20260807 15:20:02.024291 20604 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:02.024922 20604 heartbeater.cc:511] Master 127.15.242.254:40075 requested a full tablet report, sending...
I20260807 15:20:02.026288 20067 ts_manager.cc:194] Registered new tserver with Master: 07026934cb7541cf8da3245f034eb274 (127.15.242.194:34331)
I20260807 15:20:02.027324 20067 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:53795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:20:02.041958 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:40075
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:02.157198 20611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:02.157470 20611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:02.157547 20611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:02.161599 20611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:02.161659 20611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:02.161717 20611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:02.167109 20611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:40075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:02.168227 20611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:02.169353 20611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:02.179522 20618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:02.179517 20621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:02.179517 20626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:02.179700 20611 server_base.cc:1034] running on GCE node
I20260807 15:20:02.180326 20611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:02.181068 20611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:02.182240 20611 hybrid_clock.cc:648] HybridClock initialized: now 1786116002182226 us; error 27 us; skew 500 ppm
Aug 07 15:20:02 dist-test-slave-g170 krb5kdc[20002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116002, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:02.185532 20611 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:20:02.186420 20611 webserver.cc:460] Webserver started at http://127.15.242.195:34919/ using document root <none> and password file <none>
I20260807 15:20:02.187009 20611 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:02.187071 20611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:02.187354 20611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:02.189811 20611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "043e3587e8124f53a0443b89f33432ee"
format_stamp: "Formatted at 2026-08-07 15:20:02 on dist-test-slave-g170"
server_key: "7ce9c6a93747d926d4f87c966875d7da"
server_key_iv: "ed64089377feaa9dabd7612b3f7cb7fa"
server_key_version: "encryptionkey@0"
I20260807 15:20:02.190387 20611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "043e3587e8124f53a0443b89f33432ee"
format_stamp: "Formatted at 2026-08-07 15:20:02 on dist-test-slave-g170"
server_key: "7ce9c6a93747d926d4f87c966875d7da"
server_key_iv: "ed64089377feaa9dabd7612b3f7cb7fa"
server_key_version: "encryptionkey@0"
I20260807 15:20:02.194317 20611 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:02.196799 20638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:02.198112 20611 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:20:02.198251 20611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "043e3587e8124f53a0443b89f33432ee"
format_stamp: "Formatted at 2026-08-07 15:20:02 on dist-test-slave-g170"
server_key: "7ce9c6a93747d926d4f87c966875d7da"
server_key_iv: "ed64089377feaa9dabd7612b3f7cb7fa"
server_key_version: "encryptionkey@0"
I20260807 15:20:02.198410 20611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:02.214949 20611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:02.218336 20611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:02.218490 20611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:02.219105 20611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:02.219923 20611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:02.219972 20611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:02.220012 20611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:02.220034 20611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:02.229112 20611 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:37353
I20260807 15:20:02.229136 20808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:37353 every 8 connection(s)
I20260807 15:20:02.230013 20611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:02.239253 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 20611
I20260807 15:20:02.239382 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
Aug 07 15:20:02 dist-test-slave-g170 krb5kdc[20002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116002, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:02.239742 16331 external_mini_cluster.cc:1428] Setting key 56c3ec831d6df30cfed256bc425ffdf0
I20260807 15:20:02.243763 20135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:02.231863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:38103 (local address 127.15.242.254:40075)
0807 15:20:02.232016 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:02.232021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:02.233168 (+ 1147us) server_negotiation.cc:407] Connection header received
0807 15:20:02.234106 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:02.234109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:02.234157 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:02.234248 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:02.235502 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:02.236085 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:02.237269 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:02.237479 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:02.237559 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:02.240245 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:02.240248 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:02.240250 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:02.240274 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:02.241757 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:02.242274 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:02.242279 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:02.242281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:02.242363 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:02.242706 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:02.242710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:02.242712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:02.242888 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:02.242996 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:02.243478 (+ 482us) server_negotiation.cc:299] Negotiation successful
0807 15:20:02.243594 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 15:20:02.244521 20813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:02.232297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:40075 (local address 127.15.242.195:38103)
0807 15:20:02.233024 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:02.233067 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:02.233908 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:02.234456 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:02.234463 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:02.234867 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:02.235354 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:02.235368 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:02.236219 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:02.236222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:02.237152 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:02.237163 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:02.237608 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:02.237611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:02.237760 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:02.238298 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:02.238313 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:02.240049 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:02.241881 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:02.241887 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:02.241902 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:02.242162 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:02.242456 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:02.242459 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:02.242461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:02.242607 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:02.242996 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:02.243004 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:02.243238 (+ 234us) client_negotiation.cc:769] Sending connection context
0807 15:20:02.243420 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 15:20:02.243740 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":118,"threads_started":1}
I20260807 15:20:02.245625 20809 heartbeater.cc:347] Connected to a master server at 127.15.242.254:40075
I20260807 15:20:02.245860 20809 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:02.246351 20809 heartbeater.cc:511] Master 127.15.242.254:40075 requested a full tablet report, sending...
I20260807 15:20:02.247331 20067 ts_manager.cc:194] Registered new tserver with Master: 043e3587e8124f53a0443b89f33432ee (127.15.242.195:37353)
I20260807 15:20:02.247903 20067 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:38103
I20260807 15:20:02.253742 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 15:20:02.269380 20135 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:02.267431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40414 (local address 127.15.242.254:40075)
0807 15:20:02.267581 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:02.267586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:02.267886 (+ 300us) server_negotiation.cc:407] Connection header received
0807 15:20:02.268027 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:02.268033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:02.268095 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:02.268197 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:02.269214 (+ 1017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40414: BlockingRecv error: recv got EOF from 127.0.0.1:40414 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:20:02.271153 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 20175
I20260807 15:20:02.289350 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 20401
I20260807 15:20:02.305258 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 20611
I20260807 15:20:02.317595 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 20018
2026-08-07T15:20:02Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2529 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:02 dist-test-slave-g170 krb5kdc[20826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:02 dist-test-slave-g170 krb5kdc[20826](info): set up 2 sockets
Aug 07 15:20:02 dist-test-slave-g170 krb5kdc[20826](info): commencing operation
krb5kdc: starting...
W20260807 15:20:03.599527 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:03 dist-test-slave-g170 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:03.733497 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38325
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:03.854928 20842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:03.855252 20842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:03.855324 20842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:03.859537 20842 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:03.859637 20842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:03.859674 20842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:03.859714 20842 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:03.859753 20842 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:03.865170 20842 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:03.866320 20842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:03.867390 20842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:03.876317 20848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:03.876322 20851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:03.876370 20849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:03.876710 20842 server_base.cc:1034] running on GCE node
I20260807 15:20:03.877324 20842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:03.878518 20842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:03.879760 20842 hybrid_clock.cc:648] HybridClock initialized: now 1786116003879721 us; error 48 us; skew 500 ppm
Aug 07 15:20:03 dist-test-slave-g170 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116003, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:03.883054 20842 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:03.884042 20842 webserver.cc:460] Webserver started at http://127.15.242.254:46391/ using document root <none> and password file <none>
I20260807 15:20:03.884699 20842 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:03.884835 20842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:03.885133 20842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:03.887471 20842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "d929558f4f62479ab0cf9466fce36434"
format_stamp: "Formatted at 2026-08-07 15:20:03 on dist-test-slave-g170"
server_key: "23885cb47f8532f25eeced46d9178816"
server_key_iv: "3dffbb4834cc2cfaa070edd37e695c7f"
server_key_version: "encryptionkey@0"
I20260807 15:20:03.888111 20842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "d929558f4f62479ab0cf9466fce36434"
format_stamp: "Formatted at 2026-08-07 15:20:03 on dist-test-slave-g170"
server_key: "23885cb47f8532f25eeced46d9178816"
server_key_iv: "3dffbb4834cc2cfaa070edd37e695c7f"
server_key_version: "encryptionkey@0"
I20260807 15:20:03.893143 20842 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 15:20:03.896045 20861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:03.897667 20842 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:03.897835 20842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "d929558f4f62479ab0cf9466fce36434"
format_stamp: "Formatted at 2026-08-07 15:20:03 on dist-test-slave-g170"
server_key: "23885cb47f8532f25eeced46d9178816"
server_key_iv: "3dffbb4834cc2cfaa070edd37e695c7f"
server_key_version: "encryptionkey@0"
I20260807 15:20:03.897958 20842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:03.914479 20842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:03.917874 20842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:03.918108 20842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:03.927835 20842 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38325
I20260807 15:20:03.928140 20952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38325 every 8 connection(s)
I20260807 15:20:03.929018 20842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:03.931699 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 20842
I20260807 15:20:03.931839 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:03.932171 16331 external_mini_cluster.cc:1428] Setting key 09a2769e55af18d874c6c76cf33da23c
I20260807 15:20:03.932559 20953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:03.939658 20953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434: Bootstrap starting.
Aug 07 15:20:03 dist-test-slave-g170 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:03.942602 20953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:03.943465 20953 log.cc:824] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:03.946144 20953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434: No bootstrap required, opened a new log
I20260807 15:20:03.947793 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:03.933804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54976 (local address 127.15.242.254:38325)
0807 15:20:03.934344 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:03.934364 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:03.934402 (+ 38us) server_negotiation.cc:407] Connection header received
0807 15:20:03.935110 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:03.935129 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:03.935461 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:03.935833 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:03.936714 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:03.937834 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:03.938757 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:03.939250 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:03.939426 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:03.942451 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:03.942462 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:03.942476 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:03.942505 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:03.944740 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:03.945341 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:03.945346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:03.945351 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:03.945462 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:03.945793 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:03.945795 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:03.945796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:03.946186 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:03.946404 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:03.946705 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 15:20:03.947015 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":202,"threads_started":1}
I20260807 15:20:03.950479 20953 raft_consensus.cc:348] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d929558f4f62479ab0cf9466fce36434" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38325 } }
I20260807 15:20:03.950757 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:20:03.950805 20953 raft_consensus.cc:374] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:03.950901 20953 raft_consensus.cc:729] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d929558f4f62479ab0cf9466fce36434, State: Initialized, Role: FOLLOWER
I20260807 15:20:03.951427 20953 consensus_queue.cc:260] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d929558f4f62479ab0cf9466fce36434" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38325 } }
I20260807 15:20:03.951596 20953 raft_consensus.cc:388] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:03.951675 20953 raft_consensus.cc:482] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:03.951792 20953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:03.952826 20953 raft_consensus.cc:504] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d929558f4f62479ab0cf9466fce36434" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38325 } }
I20260807 15:20:03.953281 20953 leader_election.cc:302] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d929558f4f62479ab0cf9466fce36434; no voters:
I20260807 15:20:03.953694 20953 leader_election.cc:288] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:03.953841 20962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:03.954094 20962 raft_consensus.cc:686] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [term 1 LEADER]: Becoming Leader. State: Replica: d929558f4f62479ab0cf9466fce36434, State: Running, Role: LEADER
I20260807 15:20:03.954392 20962 consensus_queue.cc:237] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d929558f4f62479ab0cf9466fce36434" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38325 } }
I20260807 15:20:03.955251 20953 sys_catalog.cc:564] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:03.955452 20962 sys_catalog.cc:455] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d929558f4f62479ab0cf9466fce36434. Latest consensus state: current_term: 1 leader_uuid: "d929558f4f62479ab0cf9466fce36434" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d929558f4f62479ab0cf9466fce36434" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38325 } } }
I20260807 15:20:03.955575 20962 sys_catalog.cc:458] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:03.956038 20969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:03.956205 20965 sys_catalog.cc:455] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d929558f4f62479ab0cf9466fce36434" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d929558f4f62479ab0cf9466fce36434" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38325 } } }
I20260807 15:20:03.956355 20965 sys_catalog.cc:458] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:03.959600 20969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:03.965755 20969 catalog_manager.cc:1347] Generated new cluster ID: 025e3b5f8b354f8394eb33f5bb1882b6
I20260807 15:20:03.965837 20969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:03.976382 20969 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:03.977524 20969 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:03.985476 20969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d929558f4f62479ab0cf9466fce36434: Generated new TSK 0
I20260807 15:20:03.986061 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:03.979203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54982 (local address 127.15.242.254:38325)
0807 15:20:03.979339 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:03.979343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:03.979754 (+ 411us) server_negotiation.cc:407] Connection header received
0807 15:20:03.979929 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:03.979932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:03.979980 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:03.980059 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:03.980755 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:03.981570 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:03.982936 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:03.983309 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:03.983417 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:03.984485 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:03.984489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:03.984492 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:03.985189 (+ 697us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:03.985228 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:03.985251 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:03.985345 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:03.985552 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 15:20:03.985906 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 15:20:03.986265 20969 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:20:03.998752 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 20842
2026-08-07T15:20:04Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1687 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:04 dist-test-slave-g170 krb5kdc[21001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:04 dist-test-slave-g170 krb5kdc[21001](info): set up 2 sockets
Aug 07 15:20:04 dist-test-slave-g170 krb5kdc[21001](info): commencing operation
krb5kdc: starting...
W20260807 15:20:05.366225 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:05 dist-test-slave-g170 krb5kdc[21001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:05.509222 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:44189
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:44189
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:05.628082 21024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:05.628382 21024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:05.628464 21024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:05.632490 21024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:05.632582 21024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:05.632644 21024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:05.632681 21024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:05.632728 21024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:05.638176 21024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:44189
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:44189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:05.639310 21024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:05.640401 21024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:05.649534 21030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:05.649544 21024 server_base.cc:1034] running on GCE node
W20260807 15:20:05.649587 21039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:05.649534 21032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:05.650322 21024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:05.651489 21024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:05.652685 21024 hybrid_clock.cc:648] HybridClock initialized: now 1786116005652664 us; error 33 us; skew 500 ppm
Aug 07 15:20:05 dist-test-slave-g170 krb5kdc[21001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116005, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:05.660987 21024 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:05.662130 21024 webserver.cc:460] Webserver started at http://127.15.242.254:35905/ using document root <none> and password file <none>
I20260807 15:20:05.662801 21024 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:05.662914 21024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:05.663192 21024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:05.665683 21024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "d4d9968794c340c78138c60d73dd431f"
format_stamp: "Formatted at 2026-08-07 15:20:05 on dist-test-slave-g170"
server_key: "0a5b7c7edbe9fa43b7a48b374dc93a30"
server_key_iv: "45fbfbb0b3accc1322752ea202e124c4"
server_key_version: "encryptionkey@0"
I20260807 15:20:05.666365 21024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "d4d9968794c340c78138c60d73dd431f"
format_stamp: "Formatted at 2026-08-07 15:20:05 on dist-test-slave-g170"
server_key: "0a5b7c7edbe9fa43b7a48b374dc93a30"
server_key_iv: "45fbfbb0b3accc1322752ea202e124c4"
server_key_version: "encryptionkey@0"
I20260807 15:20:05.670708 21024 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:05.673511 21050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:05.674994 21024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:05.675160 21024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "d4d9968794c340c78138c60d73dd431f"
format_stamp: "Formatted at 2026-08-07 15:20:05 on dist-test-slave-g170"
server_key: "0a5b7c7edbe9fa43b7a48b374dc93a30"
server_key_iv: "45fbfbb0b3accc1322752ea202e124c4"
server_key_version: "encryptionkey@0"
I20260807 15:20:05.675305 21024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:05.686568 21024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:05.690352 21024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:05.690583 21024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:05.698638 21024 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:44189
I20260807 15:20:05.698997 21128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:44189 every 8 connection(s)
I20260807 15:20:05.699662 21024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:05.702687 21130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:05.707010 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 21024
I20260807 15:20:05.707190 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:05.707481 16331 external_mini_cluster.cc:1428] Setting key 20715654f1c3d0699d8ea11d67e3101a
I20260807 15:20:05.708895 21130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f: Bootstrap starting.
I20260807 15:20:05.711283 21130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:05.712312 21130 log.cc:824] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:05.714576 21130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f: No bootstrap required, opened a new log
Aug 07 15:20:05 dist-test-slave-g170 krb5kdc[21001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:05.719550 21130 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4d9968794c340c78138c60d73dd431f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44189 } }
I20260807 15:20:05.719936 21130 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:05.720000 21130 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4d9968794c340c78138c60d73dd431f, State: Initialized, Role: FOLLOWER
I20260807 15:20:05.720537 21130 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4d9968794c340c78138c60d73dd431f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44189 } }
I20260807 15:20:05.720722 21130 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:05.720827 21130 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:05.720933 21130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:05.722194 21130 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4d9968794c340c78138c60d73dd431f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44189 } }
I20260807 15:20:05.722589 21130 leader_election.cc:302] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4d9968794c340c78138c60d73dd431f; no voters:
I20260807 15:20:05.722996 21130 leader_election.cc:288] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:05.723079 21135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:05.723326 21135 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [term 1 LEADER]: Becoming Leader. State: Replica: d4d9968794c340c78138c60d73dd431f, State: Running, Role: LEADER
I20260807 15:20:05.723651 21135 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4d9968794c340c78138c60d73dd431f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44189 } }
I20260807 15:20:05.724450 21130 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:05.724483 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:05.709317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35430 (local address 127.15.242.254:44189)
0807 15:20:05.709821 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:05.709855 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:05.709894 (+ 39us) server_negotiation.cc:407] Connection header received
0807 15:20:05.710540 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:05.710558 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:05.710901 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:05.711201 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:05.712193 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:05.713355 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:05.714539 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:05.715186 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:05.715328 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:05.718390 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:05.718399 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:05.718419 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:05.718453 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:05.720695 (+ 2242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:05.721342 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:05.721349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:05.721355 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:05.721494 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:05.721824 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:05.721831 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:05.721835 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:05.722422 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:05.722622 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:05.723019 (+ 397us) server_negotiation.cc:299] Negotiation successful
0807 15:20:05.723400 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":151,"threads_started":1}
I20260807 15:20:05.725630 21139 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4d9968794c340c78138c60d73dd431f. Latest consensus state: current_term: 1 leader_uuid: "d4d9968794c340c78138c60d73dd431f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4d9968794c340c78138c60d73dd431f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44189 } } }
I20260807 15:20:05.725852 21139 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:05.726317 21136 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4d9968794c340c78138c60d73dd431f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4d9968794c340c78138c60d73dd431f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44189 } } }
I20260807 15:20:05.726454 21136 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:05.727240 21156 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:05.730346 21156 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:05.736804 21156 catalog_manager.cc:1347] Generated new cluster ID: 7e1a8e2777684974993b1bfca36bf5d2
I20260807 15:20:05.736882 21156 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:05.749155 21156 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:05.750154 21156 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:05.759568 21156 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4d9968794c340c78138c60d73dd431f: Generated new TSK 0
I20260807 15:20:05.760389 21156 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:20:05.801050 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44189
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:05.925590 21178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:05.925906 21178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:05.926017 21178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:05.930356 21178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:05.930428 21178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:05.930526 21178 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:05.936028 21178 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:05.937222 21178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:05.938403 21178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:05.948627 21184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:05.948626 21186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:05.948632 21183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:05.948958 21178 server_base.cc:1034] running on GCE node
I20260807 15:20:05.949505 21178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:05.950433 21178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:05.951654 21178 hybrid_clock.cc:648] HybridClock initialized: now 1786116005951628 us; error 42 us; skew 500 ppm
Aug 07 15:20:05 dist-test-slave-g170 krb5kdc[21001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116005, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:05.954862 21178 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:20:05.955909 21178 webserver.cc:460] Webserver started at http://127.15.242.193:34937/ using document root <none> and password file <none>
I20260807 15:20:05.956561 21178 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:05.956665 21178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:05.956961 21178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:05.959223 21178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "3b4de55b9ad741a0b4e08add04591df6"
format_stamp: "Formatted at 2026-08-07 15:20:05 on dist-test-slave-g170"
server_key: "bd5c4abe08fd952395005b3a92bc6814"
server_key_iv: "005bec51bd923d3f05dad05614c4f47f"
server_key_version: "encryptionkey@0"
I20260807 15:20:05.959882 21178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "3b4de55b9ad741a0b4e08add04591df6"
format_stamp: "Formatted at 2026-08-07 15:20:05 on dist-test-slave-g170"
server_key: "bd5c4abe08fd952395005b3a92bc6814"
server_key_iv: "005bec51bd923d3f05dad05614c4f47f"
server_key_version: "encryptionkey@0"
I20260807 15:20:05.964170 21178 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:20:05.967093 21197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:05.968611 21178 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:05.968883 21178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "3b4de55b9ad741a0b4e08add04591df6"
format_stamp: "Formatted at 2026-08-07 15:20:05 on dist-test-slave-g170"
server_key: "bd5c4abe08fd952395005b3a92bc6814"
server_key_iv: "005bec51bd923d3f05dad05614c4f47f"
server_key_version: "encryptionkey@0"
I20260807 15:20:05.969013 21178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:05.993754 21178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:05.998790 21178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:05.999123 21178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:05.999804 21178 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:06.000878 21178 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:06.000953 21178 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:06.001030 21178 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:06.001101 21178 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:06.011693 21178 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:39193
I20260807 15:20:06.011760 21385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:39193 every 8 connection(s)
I20260807 15:20:06.012871 21178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:06.019966 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 21178
I20260807 15:20:06.020134 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:06.020443 16331 external_mini_cluster.cc:1428] Setting key 9776609422d7bf09bf2a7110b896423e
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116005, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:06.031733 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:06.015132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:42717 (local address 127.15.242.254:44189)
0807 15:20:06.015297 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:06.015301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:06.016397 (+ 1096us) server_negotiation.cc:407] Connection header received
0807 15:20:06.018079 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:06.018083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:06.018150 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:06.018282 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:06.019774 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.020471 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.022072 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.022408 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.022530 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:06.026580 (+ 4050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:06.026587 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:06.026594 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:06.026637 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:06.028883 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:06.029579 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:06.029587 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:06.029593 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:06.029710 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:06.030164 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:06.030170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:06.030183 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:06.030513 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:06.030648 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:06.031331 (+ 683us) server_negotiation.cc:299] Negotiation successful
0807 15:20:06.031506 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 15:20:06.032686 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:06.015557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44189 (local address 127.15.242.193:42717)
0807 15:20:06.016184 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:06.016244 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:06.017813 (+ 1569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:06.018507 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:06.018515 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:06.018966 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:06.019528 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:06.019543 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.020643 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.020646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:06.021898 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:06.021914 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.022643 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.022650 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:06.022951 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:06.023749 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:06.023779 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:06.026359 (+ 2580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:06.029065 (+ 2706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:06.029072 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:06.029088 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:06.029432 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:06.029836 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:06.029839 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:06.029841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:06.030028 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:06.030697 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:06.030704 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:06.031006 (+ 302us) client_negotiation.cc:769] Sending connection context
0807 15:20:06.031209 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 15:20:06.031584 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":142,"threads_started":1}
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:20:06.034353 21386 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44189
I20260807 15:20:06.034706 21386 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:06.035391 21386 heartbeater.cc:511] Master 127.15.242.254:44189 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:20:06.037518 21076 ts_manager.cc:194] Registered new tserver with Master: 3b4de55b9ad741a0b4e08add04591df6 (127.15.242.193:39193)
I20260807 15:20:06.038794 21076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:42717
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:20:06.057066 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44189
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:06.185892 21394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:06.186205 21394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:06.186295 21394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:06.190773 21394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:06.190860 21394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:06.190951 21394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:06.196159 21394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:06.197252 21394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:06.198297 21394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:06.208249 21402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:06.208249 21403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:06.208388 21394 server_base.cc:1034] running on GCE node
W20260807 15:20:06.208287 21410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:06.209046 21394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:06.209699 21394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:06.210892 21394 hybrid_clock.cc:648] HybridClock initialized: now 1786116006210870 us; error 31 us; skew 500 ppm
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116006, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:06.214078 21394 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:20:06.214994 21394 webserver.cc:460] Webserver started at http://127.15.242.194:35999/ using document root <none> and password file <none>
I20260807 15:20:06.215565 21394 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:06.215641 21394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:06.215826 21394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:06.218106 21394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "c1fdea8197f44e33bcded8667a3a530e"
format_stamp: "Formatted at 2026-08-07 15:20:06 on dist-test-slave-g170"
server_key: "831caefebc1c2eefb533dd3fbd72e7f9"
server_key_iv: "a55cd97f988743ab3c21c6b8b19c1108"
server_key_version: "encryptionkey@0"
I20260807 15:20:06.218701 21394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "c1fdea8197f44e33bcded8667a3a530e"
format_stamp: "Formatted at 2026-08-07 15:20:06 on dist-test-slave-g170"
server_key: "831caefebc1c2eefb533dd3fbd72e7f9"
server_key_iv: "a55cd97f988743ab3c21c6b8b19c1108"
server_key_version: "encryptionkey@0"
I20260807 15:20:06.222754 21394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:06.225683 21418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:06.227162 21394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:06.227332 21394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "c1fdea8197f44e33bcded8667a3a530e"
format_stamp: "Formatted at 2026-08-07 15:20:06 on dist-test-slave-g170"
server_key: "831caefebc1c2eefb533dd3fbd72e7f9"
server_key_iv: "a55cd97f988743ab3c21c6b8b19c1108"
server_key_version: "encryptionkey@0"
I20260807 15:20:06.227458 21394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:06.251156 21394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:06.254654 21394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:06.254901 21394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:06.255611 21394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:06.256583 21394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:06.256676 21394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:06.256793 21394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:06.256847 21394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 15:20:06.267509 21394 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:43445
I20260807 15:20:06.267544 21587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:43445 every 8 connection(s)
I20260807 15:20:06.268914 21394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:06.275956 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 21394
I20260807 15:20:06.276079 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:06.276403 16331 external_mini_cluster.cc:1428] Setting key a93684d4963604c59f19f7159758cdd3
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116006, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:06.288193 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:06.271136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:56475 (local address 127.15.242.254:44189)
0807 15:20:06.271391 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:06.271403 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:06.272708 (+ 1305us) server_negotiation.cc:407] Connection header received
0807 15:20:06.274560 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:06.274567 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:06.274639 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:06.274755 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:06.276487 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.277401 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.279189 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.279533 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.279653 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:06.283993 (+ 4340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:06.283999 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:06.284003 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:06.284043 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:06.285830 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:06.286458 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:06.286462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:06.286464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:06.286562 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:06.286953 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:06.286959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:06.286961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:06.287178 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:06.287293 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:06.287859 (+ 566us) server_negotiation.cc:299] Negotiation successful
0807 15:20:06.288009 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:20:06.289196 21594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:06.271419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44189 (local address 127.15.242.194:56475)
0807 15:20:06.272563 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:06.272611 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:06.274283 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:06.275056 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:06.275067 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:06.275578 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:06.276317 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:06.276340 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.277539 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.277542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:06.279034 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:06.279048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.280928 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.280933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:06.281109 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:06.281769 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:06.281789 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:06.283781 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:06.285975 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:06.285983 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:06.286001 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:06.286334 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:06.286676 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:06.286680 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:06.286682 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:06.286842 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:06.287315 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:06.287322 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:06.287595 (+ 273us) client_negotiation.cc:769] Sending connection context
0807 15:20:06.287812 (+ 217us) client_negotiation.cc:240] Negotiation successful
0807 15:20:06.288184 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"thread_start_us":112,"threads_started":1}
I20260807 15:20:06.290535 21591 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44189
I20260807 15:20:06.290799 21591 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:06.291395 21591 heartbeater.cc:511] Master 127.15.242.254:44189 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:20:06.292718 21076 ts_manager.cc:194] Registered new tserver with Master: c1fdea8197f44e33bcded8667a3a530e (127.15.242.194:43445)
I20260807 15:20:06.293393 21076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:56475
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:20:06.311762 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44189
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:06.428445 21597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:06.428690 21597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:06.428731 21597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:06.432818 21597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:06.432881 21597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:06.432938 21597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:06.438339 21597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:06.439463 21597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:06.440549 21597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:06.450975 21606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:06.450932 21605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:06.451010 21609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:06.451225 21597 server_base.cc:1034] running on GCE node
I20260807 15:20:06.451848 21597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:06.452538 21597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:06.453753 21597 hybrid_clock.cc:648] HybridClock initialized: now 1786116006453720 us; error 49 us; skew 500 ppm
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116006, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:06.460443 21597 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:20:06.461519 21597 webserver.cc:460] Webserver started at http://127.15.242.195:35123/ using document root <none> and password file <none>
I20260807 15:20:06.462167 21597 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:06.462245 21597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:06.462515 21597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:06.464851 21597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "c35d2842725347c397ddbde184bc5bea"
format_stamp: "Formatted at 2026-08-07 15:20:06 on dist-test-slave-g170"
server_key: "7fb859c4c9358754a4ff191563a1184b"
server_key_iv: "0471031d667beb8860873588fb1b3da5"
server_key_version: "encryptionkey@0"
I20260807 15:20:06.465480 21597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "c35d2842725347c397ddbde184bc5bea"
format_stamp: "Formatted at 2026-08-07 15:20:06 on dist-test-slave-g170"
server_key: "7fb859c4c9358754a4ff191563a1184b"
server_key_iv: "0471031d667beb8860873588fb1b3da5"
server_key_version: "encryptionkey@0"
I20260807 15:20:06.469681 21597 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:20:06.472407 21623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:06.473855 21597 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:20:06.473999 21597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "c35d2842725347c397ddbde184bc5bea"
format_stamp: "Formatted at 2026-08-07 15:20:06 on dist-test-slave-g170"
server_key: "7fb859c4c9358754a4ff191563a1184b"
server_key_iv: "0471031d667beb8860873588fb1b3da5"
server_key_version: "encryptionkey@0"
I20260807 15:20:06.474102 21597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:06.517074 21597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:06.521098 21597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:06.521342 21597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:06.522089 21597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:06.523051 21597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:06.523102 21597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:06.523183 21597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:06.523229 21597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:06.533985 21597 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:41911
I20260807 15:20:06.534008 21795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:41911 every 8 connection(s)
I20260807 15:20:06.535032 21597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:06.539937 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 21597
I20260807 15:20:06.540117 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:06.540448 16331 external_mini_cluster.cc:1428] Setting key 559273eee31fad7e8ed5333f498b3261
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116006, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:06.551381 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:06.537192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:40213 (local address 127.15.242.254:44189)
0807 15:20:06.537355 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:06.537359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:06.538290 (+ 931us) server_negotiation.cc:407] Connection header received
0807 15:20:06.539953 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:06.539957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:06.540052 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:06.540209 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:06.542157 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.542861 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.544271 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.544522 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.544671 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:06.547532 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:06.547536 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:06.547538 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:06.547566 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:06.549054 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:06.549632 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:06.549636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:06.549638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:06.549737 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:06.550187 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:06.550190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:06.550192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:06.550406 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:06.550503 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:06.551093 (+ 590us) server_negotiation.cc:299] Negotiation successful
0807 15:20:06.551229 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 15:20:06.552356 21800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:06.537504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44189 (local address 127.15.242.195:40213)
0807 15:20:06.538076 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:06.538136 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:06.539664 (+ 1528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:06.540417 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:06.540426 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:06.541224 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:06.541984 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:06.542004 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.543019 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.543023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:06.544121 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:06.544132 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.544733 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.544738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:06.544963 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:06.545739 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:06.545757 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:06.547344 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:06.549197 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:06.549204 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:06.549218 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:06.549507 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:06.549891 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:06.549894 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:06.549896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:06.550059 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:06.550542 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:06.550548 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:06.550832 (+ 284us) client_negotiation.cc:769] Sending connection context
0807 15:20:06.551024 (+ 192us) client_negotiation.cc:240] Negotiation successful
0807 15:20:06.551326 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":167,"threads_started":1}
I20260807 15:20:06.553797 21796 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44189
I20260807 15:20:06.554101 21796 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:06.554777 21796 heartbeater.cc:511] Master 127.15.242.254:44189 requested a full tablet report, sending...
I20260807 15:20:06.556020 21076 ts_manager.cc:194] Registered new tserver with Master: c35d2842725347c397ddbde184bc5bea (127.15.242.195:41911)
I20260807 15:20:06.556595 21076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:40213
I20260807 15:20:06.567607 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116006, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:06.596925 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:06.587485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40632 (local address 127.15.242.254:44189)
0807 15:20:06.587717 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:06.587723 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:06.587874 (+ 151us) server_negotiation.cc:407] Connection header received
0807 15:20:06.588098 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:06.588101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:06.588151 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:06.588250 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:06.589168 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.589791 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.590739 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:06.590979 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:06.591098 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:06.593734 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:06.593738 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:06.593740 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:06.593766 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:06.595145 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:06.595589 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:06.595598 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:06.595599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:06.595676 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:06.595965 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:06.595969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:06.595970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:06.596195 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:06.596349 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:06.596599 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 15:20:06.596729 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
W20260807 15:20:06.597349 21076 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40632
I20260807 15:20:06.598482 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 21178
I20260807 15:20:06.623078 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 21394
I20260807 15:20:06.634969 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 21597
I20260807 15:20:06.648556 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 21024
2026-08-07T15:20:06Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2644 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21813](info): set up 2 sockets
Aug 07 15:20:06 dist-test-slave-g170 krb5kdc[21813](info): commencing operation
krb5kdc: starting...
W20260807 15:20:07.925050 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:08 dist-test-slave-g170 krb5kdc[21813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:08.064400 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39431
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:39431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:08.184710 21837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:08.185012 21837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:08.185052 21837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:08.189077 21837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:08.189141 21837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:08.189159 21837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:08.189177 21837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:08.189191 21837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:08.194618 21837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:39431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:08.195752 21837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:08.197293 21837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:08.206609 21846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:08.206660 21837 server_base.cc:1034] running on GCE node
W20260807 15:20:08.206598 21847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:08.206578 21850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:08.207499 21837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:08.208659 21837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:08.209841 21837 hybrid_clock.cc:648] HybridClock initialized: now 1786116008209828 us; error 34 us; skew 500 ppm
Aug 07 15:20:08 dist-test-slave-g170 krb5kdc[21813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116008, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:08.212972 21837 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:08.213945 21837 webserver.cc:460] Webserver started at http://127.15.242.254:42363/ using document root <none> and password file <none>
I20260807 15:20:08.214548 21837 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:08.214617 21837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:08.214848 21837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:08.217093 21837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "cd02db668eb342aba4c27ab65bf4d922"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "ce8b6f278bb14177d74d4736e8bc7864"
server_key_iv: "bf2f84765239ad328a59e1d0b9c59c09"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.217710 21837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "cd02db668eb342aba4c27ab65bf4d922"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "ce8b6f278bb14177d74d4736e8bc7864"
server_key_iv: "bf2f84765239ad328a59e1d0b9c59c09"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.221894 21837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:20:08.224643 21859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:08.226172 21837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:20:08.226290 21837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "cd02db668eb342aba4c27ab65bf4d922"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "ce8b6f278bb14177d74d4736e8bc7864"
server_key_iv: "bf2f84765239ad328a59e1d0b9c59c09"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.226549 21837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:08.253880 21837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:08.257364 21837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:08.257699 21837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:08.265952 21837 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:39431
I20260807 15:20:08.265964 21935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:39431 every 8 connection(s)
I20260807 15:20:08.267086 21837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:08.271323 21936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:08.272068 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 21837
I20260807 15:20:08.272217 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:08.272580 16331 external_mini_cluster.cc:1428] Setting key e4a1450da19b6b5dfd676d1cc296524e
I20260807 15:20:08.278738 21936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922: Bootstrap starting.
I20260807 15:20:08.281642 21936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:08.282639 21936 log.cc:824] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922: Log is configured to *not* fsync() on all Append() calls
Aug 07 15:20:08 dist-test-slave-g170 krb5kdc[21813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:08.285064 21936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922: No bootstrap required, opened a new log
I20260807 15:20:08.289201 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:08.274611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42948 (local address 127.15.242.254:39431)
0807 15:20:08.275184 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:08.275208 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:08.275263 (+ 55us) server_negotiation.cc:407] Connection header received
0807 15:20:08.276091 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:08.276112 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:08.276487 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:08.276864 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:08.277826 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.278860 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.280120 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.280609 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.280749 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:08.283943 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:08.283948 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:08.283962 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:08.283989 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:08.286013 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:08.286529 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:08.286535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:08.286540 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:08.286666 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:08.286980 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:08.286983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:08.286984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:08.287421 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:08.287580 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:08.287947 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 15:20:08.288320 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":138,"threads_started":1}
I20260807 15:20:08.289368 21936 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd02db668eb342aba4c27ab65bf4d922" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39431 } }
I20260807 15:20:08.289669 21936 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:08.289754 21936 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd02db668eb342aba4c27ab65bf4d922, State: Initialized, Role: FOLLOWER
I20260807 15:20:08.290287 21936 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd02db668eb342aba4c27ab65bf4d922" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39431 } }
I20260807 15:20:08.290480 21936 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:08.290550 21936 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:08.290650 21936 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:08.291900 21936 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd02db668eb342aba4c27ab65bf4d922" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39431 } }
I20260807 15:20:08.292232 21936 leader_election.cc:302] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd02db668eb342aba4c27ab65bf4d922; no voters:
I20260807 15:20:08.292500 21936 leader_election.cc:288] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:08.292825 21942 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:08.293056 21942 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [term 1 LEADER]: Becoming Leader. State: Replica: cd02db668eb342aba4c27ab65bf4d922, State: Running, Role: LEADER
I20260807 15:20:08.293397 21942 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd02db668eb342aba4c27ab65bf4d922" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39431 } }
I20260807 15:20:08.293888 21936 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:08.295424 21945 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd02db668eb342aba4c27ab65bf4d922. Latest consensus state: current_term: 1 leader_uuid: "cd02db668eb342aba4c27ab65bf4d922" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd02db668eb342aba4c27ab65bf4d922" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39431 } } }
I20260807 15:20:08.295482 21943 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd02db668eb342aba4c27ab65bf4d922" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd02db668eb342aba4c27ab65bf4d922" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39431 } } }
I20260807 15:20:08.295562 21945 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:08.295603 21943 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:08.296327 21957 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:08.299664 21957 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:08.306025 21957 catalog_manager.cc:1347] Generated new cluster ID: bc8ef35f4ce24c0c9ee97320817d76aa
I20260807 15:20:08.306124 21957 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:08.321587 21957 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:08.322610 21957 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:08.333870 21957 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd02db668eb342aba4c27ab65bf4d922: Generated new TSK 0
I20260807 15:20:08.334647 21957 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:20:08.372644 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39431
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:08.502471 21971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:08.502731 21971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:08.502774 21971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:08.506744 21971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:08.506796 21971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:08.506851 21971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:08.512128 21971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:08.513185 21971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:08.514150 21971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:08.524276 21984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:08.524240 21980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:08.524282 21978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:08.524334 21971 server_base.cc:1034] running on GCE node
I20260807 15:20:08.525374 21971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:08.526077 21971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:08.527282 21971 hybrid_clock.cc:648] HybridClock initialized: now 1786116008527270 us; error 33 us; skew 500 ppm
Aug 07 15:20:08 dist-test-slave-g170 krb5kdc[21813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116008, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:08.530452 21971 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:20:08.531437 21971 webserver.cc:460] Webserver started at http://127.15.242.193:41091/ using document root <none> and password file <none>
I20260807 15:20:08.531976 21971 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:08.532034 21971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:08.532204 21971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:08.534360 21971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "753f37ce0cbc491ea125f205d9e49574"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "d337e0c1742533f636b84fca14d7ad09"
server_key_iv: "b503c7d52d1e7c8a8923589db66b3d7f"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.534897 21971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "753f37ce0cbc491ea125f205d9e49574"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "d337e0c1742533f636b84fca14d7ad09"
server_key_iv: "b503c7d52d1e7c8a8923589db66b3d7f"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.538803 21971 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:08.541380 21997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:08.542675 21971 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:08.542837 21971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "753f37ce0cbc491ea125f205d9e49574"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "d337e0c1742533f636b84fca14d7ad09"
server_key_iv: "b503c7d52d1e7c8a8923589db66b3d7f"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.542961 21971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:08.569082 21971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:08.572826 21971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:08.573078 21971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:08.573750 21971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:08.574697 21971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:08.574777 21971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:08.574851 21971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:08.574900 21971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:08.584545 21971 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:40973
I20260807 15:20:08.584568 22158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:40973 every 8 connection(s)
I20260807 15:20:08.585601 21971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:08.591724 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 21971
I20260807 15:20:08.591868 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:08.592221 16331 external_mini_cluster.cc:1428] Setting key f91dcaeb5e0f19dc1c9265e03efd8723
Aug 07 15:20:08 dist-test-slave-g170 krb5kdc[21813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116008, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:08.601740 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:08.587608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:48439 (local address 127.15.242.254:39431)
0807 15:20:08.587778 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:08.587782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:08.588731 (+ 949us) server_negotiation.cc:407] Connection header received
0807 15:20:08.590345 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:08.590349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:08.590415 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:08.590506 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:08.592060 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.592719 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.594463 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.594808 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.594898 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:08.597856 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:08.597860 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:08.597863 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:08.597889 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:08.599459 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:08.600066 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:08.600071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:08.600073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:08.600163 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:08.600540 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:08.600543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:08.600545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:08.600743 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:08.600893 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:08.601417 (+ 524us) server_negotiation.cc:299] Negotiation successful
0807 15:20:08.601564 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 15:20:08.602597 22162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:08.587978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39431 (local address 127.15.242.193:48439)
0807 15:20:08.588504 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:08.588550 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:08.590092 (+ 1542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:08.590736 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:08.590744 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:08.591130 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:08.591859 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:08.591884 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.592886 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.592890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:08.594331 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:08.594345 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.595005 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.595012 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:08.595295 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:08.596007 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:08.596033 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:08.597683 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:08.599639 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:08.599645 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:08.599661 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:08.599947 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:08.600269 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:08.600272 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:08.600274 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:08.600429 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:08.600910 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:08.600918 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:08.601167 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 15:20:08.601375 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 15:20:08.601752 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:20:08.603953 22160 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39431
I20260807 15:20:08.604249 22160 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:08.604911 22160 heartbeater.cc:511] Master 127.15.242.254:39431 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:20:08.606757 21882 ts_manager.cc:194] Registered new tserver with Master: 753f37ce0cbc491ea125f205d9e49574 (127.15.242.193:40973)
I20260807 15:20:08.608039 21882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:48439
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:20:08.625361 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39431
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:08.744079 22166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:08.744401 22166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:08.744448 22166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:08.748790 22166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:08.748860 22166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:08.748921 22166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:08.754318 22166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:08.755420 22166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:08.756462 22166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:08.767563 22172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:08.767845 22166 server_base.cc:1034] running on GCE node
W20260807 15:20:08.767596 22173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:08.767760 22178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:08.768587 22166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:08.769381 22166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:08.770560 22166 hybrid_clock.cc:648] HybridClock initialized: now 1786116008770528 us; error 43 us; skew 500 ppm
Aug 07 15:20:08 dist-test-slave-g170 krb5kdc[21813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116008, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:08.773881 22166 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:20:08.775085 22166 webserver.cc:460] Webserver started at http://127.15.242.194:33249/ using document root <none> and password file <none>
I20260807 15:20:08.775810 22166 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:08.775885 22166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:08.776078 22166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:08.778364 22166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "e56ed44499b3471cb520cf657514f520"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "a651647abb59d7aefa8a3db155b8522d"
server_key_iv: "fd235fc5ef7ca7ea2db8668a95667304"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.778935 22166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "e56ed44499b3471cb520cf657514f520"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "a651647abb59d7aefa8a3db155b8522d"
server_key_iv: "fd235fc5ef7ca7ea2db8668a95667304"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.783215 22166 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:08.786069 22193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:08.787495 22166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:08.787719 22166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "e56ed44499b3471cb520cf657514f520"
format_stamp: "Formatted at 2026-08-07 15:20:08 on dist-test-slave-g170"
server_key: "a651647abb59d7aefa8a3db155b8522d"
server_key_iv: "fd235fc5ef7ca7ea2db8668a95667304"
server_key_version: "encryptionkey@0"
I20260807 15:20:08.787860 22166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:08.801538 22166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:08.805030 22166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:08.805259 22166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:08.805920 22166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:08.806805 22166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:08.806891 22166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:08.806962 22166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:08.807020 22166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:08.816809 22166 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:45571
I20260807 15:20:08.816951 22360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:45571 every 8 connection(s)
I20260807 15:20:08.817812 22166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:08.823256 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 22166
I20260807 15:20:08.823393 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:08.823711 16331 external_mini_cluster.cc:1428] Setting key 8c7b4e509173fd84d0a0179b7f927807
Aug 07 15:20:08 dist-test-slave-g170 krb5kdc[21813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116008, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:08.835552 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:08.819990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:58653 (local address 127.15.242.254:39431)
0807 15:20:08.820187 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:08.820192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:08.821150 (+ 958us) server_negotiation.cc:407] Connection header received
0807 15:20:08.822654 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:08.822657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:08.822720 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:08.822842 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:08.824464 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.825078 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.826785 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.827038 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.827152 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:08.830673 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:08.830680 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:08.830686 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:08.830723 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:08.832528 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:08.833366 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:08.833369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:08.833370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:08.833456 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:08.833952 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:08.833955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:08.833956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:08.834268 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:08.834360 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:08.835159 (+ 799us) server_negotiation.cc:299] Negotiation successful
0807 15:20:08.835341 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:20:08.836711 22364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:08.820392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39431 (local address 127.15.242.194:58653)
0807 15:20:08.820970 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:08.821025 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:08.822397 (+ 1372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:08.823085 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:08.823104 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:08.823636 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:08.824297 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:08.824315 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.825218 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.825226 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:08.826627 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:08.826643 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:08.827229 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:08.827236 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:08.827476 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:08.828284 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:08.828302 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:08.830231 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:08.832701 (+ 2470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:08.832711 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:08.832736 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:08.833215 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:08.833574 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:08.833580 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:08.833585 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:08.833828 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:08.834418 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:08.834427 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:08.834815 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 15:20:08.835064 (+ 249us) client_negotiation.cc:240] Negotiation successful
0807 15:20:08.835495 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":138,"threads_started":1}
I20260807 15:20:08.838105 22362 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39431
I20260807 15:20:08.838372 22362 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:08.839021 22362 heartbeater.cc:511] Master 127.15.242.254:39431 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:20:08.840276 21882 ts_manager.cc:194] Registered new tserver with Master: e56ed44499b3471cb520cf657514f520 (127.15.242.194:45571)
I20260807 15:20:08.841017 21882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:58653
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:20:08.860693 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39431
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:08.979744 22369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:08.980023 22369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:08.980067 22369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:08.984035 22369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:08.984097 22369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:08.984153 22369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:08.989563 22369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:08.990598 22369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:08.991649 22369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:09.002261 22375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:09.002403 22380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:09.002436 22369 server_base.cc:1034] running on GCE node
W20260807 15:20:09.002318 22384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:09.003125 22369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:09.003831 22369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:09.004997 22369 hybrid_clock.cc:648] HybridClock initialized: now 1786116009004980 us; error 32 us; skew 500 ppm
Aug 07 15:20:09 dist-test-slave-g170 krb5kdc[21813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116009, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:09.008525 22369 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:20:09.009946 22369 webserver.cc:460] Webserver started at http://127.15.242.195:41075/ using document root <none> and password file <none>
I20260807 15:20:09.010906 22369 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:09.011042 22369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:09.011363 22369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:09.014024 22369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "abdb93369ae4441db143faae597dd1ea"
format_stamp: "Formatted at 2026-08-07 15:20:09 on dist-test-slave-g170"
server_key: "d63b774380f3209e8229b49cdbe77823"
server_key_iv: "1c6c0d3d9c583119e5ee4cbea0fc8f21"
server_key_version: "encryptionkey@0"
I20260807 15:20:09.014735 22369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "abdb93369ae4441db143faae597dd1ea"
format_stamp: "Formatted at 2026-08-07 15:20:09 on dist-test-slave-g170"
server_key: "d63b774380f3209e8229b49cdbe77823"
server_key_iv: "1c6c0d3d9c583119e5ee4cbea0fc8f21"
server_key_version: "encryptionkey@0"
I20260807 15:20:09.019290 22369 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:09.022033 22394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:09.023401 22369 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 15:20:09.023520 22369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "abdb93369ae4441db143faae597dd1ea"
format_stamp: "Formatted at 2026-08-07 15:20:09 on dist-test-slave-g170"
server_key: "d63b774380f3209e8229b49cdbe77823"
server_key_iv: "1c6c0d3d9c583119e5ee4cbea0fc8f21"
server_key_version: "encryptionkey@0"
I20260807 15:20:09.023628 22369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:09.038060 22369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:09.041890 22369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:09.042088 22369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:09.042721 22369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:09.043653 22369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:09.043708 22369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:09.043753 22369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:09.043833 22369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:09.054194 22369 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:33293
I20260807 15:20:09.054216 22564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:33293 every 8 connection(s)
I20260807 15:20:09.055235 22369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:09.059700 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 22369
I20260807 15:20:09.059836 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:09.060195 16331 external_mini_cluster.cc:1428] Setting key fc115d69aad90ab4a8039eb6f1cd5209
Aug 07 15:20:09 dist-test-slave-g170 krb5kdc[21813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116009, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:09.070825 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:09.057248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:45215 (local address 127.15.242.254:39431)
0807 15:20:09.057422 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:09.057427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:09.058416 (+ 989us) server_negotiation.cc:407] Connection header received
0807 15:20:09.059963 (+ 1547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:09.059967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:09.060033 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:09.060111 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:09.061758 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:09.062533 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:09.064026 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:09.064400 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:09.064551 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:09.067364 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:09.067368 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:09.067370 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:09.067394 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:09.068820 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:09.069387 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:09.069390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:09.069391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:09.069468 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:09.069802 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:09.069804 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:09.069805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:09.069976 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:09.070055 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:09.070584 (+ 529us) server_negotiation.cc:299] Negotiation successful
0807 15:20:09.070694 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 15:20:09.071750 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:09.057694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39431 (local address 127.15.242.195:45215)
0807 15:20:09.058216 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:09.058261 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:09.059716 (+ 1455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:09.060333 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:09.060342 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:09.060868 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:09.061590 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:09.061612 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:09.062701 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:09.062705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:09.063855 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:09.063876 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:09.064630 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:09.064638 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:09.064921 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:09.065493 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:09.065511 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:09.067197 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:09.068952 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:09.068959 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:09.068975 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:09.069293 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:09.069558 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:09.069560 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:09.069561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:09.069709 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:09.070082 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:09.070088 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:09.070356 (+ 268us) client_negotiation.cc:769] Sending connection context
0807 15:20:09.070528 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 15:20:09.070819 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":115,"threads_started":1}
I20260807 15:20:09.073005 22565 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39431
I20260807 15:20:09.073288 22565 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:09.073808 22565 heartbeater.cc:511] Master 127.15.242.254:39431 requested a full tablet report, sending...
I20260807 15:20:09.074890 21882 ts_manager.cc:194] Registered new tserver with Master: abdb93369ae4441db143faae597dd1ea (127.15.242.195:33293)
I20260807 15:20:09.075546 21882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:45215
I20260807 15:20:09.086529 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 15:20:09 dist-test-slave-g170 krb5kdc[21813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 15:20:09 dist-test-slave-g170 krb5kdc[21813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:20:09.116024 22575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:09.105431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32784 (local address 127.15.242.193:40973)
0807 15:20:09.105803 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:09.105812 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:09.105846 (+ 34us) server_negotiation.cc:407] Connection header received
0807 15:20:09.105914 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:09.105921 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:09.106139 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:09.106322 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:09.107116 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:09.107952 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:09.109005 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:09.109424 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:09.109566 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:09.112249 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:09.112260 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:09.112274 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:09.112303 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:09.114130 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:09.114609 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:09.114615 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:09.114616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:09.114706 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:09.115004 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:09.115006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:09.115007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:09.115247 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:09.115411 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:09.115626 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 15:20:09.115839 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":69,"threads_started":1}
Aug 07 15:20:09 dist-test-slave-g170 krb5kdc[21813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:09.128067 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:09.119420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42960 (local address 127.15.242.254:39431)
0807 15:20:09.119578 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:09.119583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:09.119612 (+ 29us) server_negotiation.cc:407] Connection header received
0807 15:20:09.119730 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:09.119732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:09.119773 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:09.119853 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:09.120468 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:09.121055 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:09.121906 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:09.122110 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:09.122185 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:09.124644 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:09.124647 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:09.124653 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:09.124675 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:09.126246 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:09.126660 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:09.126663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:09.126664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:09.126771 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:09.127077 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:09.127079 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:09.127080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:09.127315 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:09.127463 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:09.127742 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 15:20:09.127871 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260807 15:20:09.128573 21882 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42960
I20260807 15:20:09.129248 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 21971
I20260807 15:20:09.147442 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 22166
I20260807 15:20:09.166700 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 22369
I20260807 15:20:09.188565 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 21837
2026-08-07T15:20:09Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2544 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:09 dist-test-slave-g170 krb5kdc[22581](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:09 dist-test-slave-g170 krb5kdc[22581](info): set up 2 sockets
Aug 07 15:20:09 dist-test-slave-g170 krb5kdc[22581](info): commencing operation
krb5kdc: starting...
W20260807 15:20:10.496505 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:10 dist-test-slave-g170 krb5kdc[22581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:10.629952 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:41443
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:41443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:10.750312 22603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:10.750700 22603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:10.750801 22603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:10.755364 22603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:10.755478 22603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:10.755523 22603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:10.755563 22603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:10.755592 22603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:10.761718 22603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:41443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:41443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:10.763036 22603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:10.764240 22603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:10.773806 22612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:10.773874 22603 server_base.cc:1034] running on GCE node
W20260807 15:20:10.773797 22609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:10.773797 22610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:10.774921 22603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:10.776125 22603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:10.777345 22603 hybrid_clock.cc:648] HybridClock initialized: now 1786116010777323 us; error 38 us; skew 500 ppm
Aug 07 15:20:10 dist-test-slave-g170 krb5kdc[22581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116010, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:10.783619 22603 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:10.784440 22603 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:10.784541 22603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:10.784863 22603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:10.787060 22603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "5c72dee69e0b42e98e8e55231ce61c99"
format_stamp: "Formatted at 2026-08-07 15:20:10 on dist-test-slave-g170"
server_key: "f703c9e004cc9349e66e6788c22d2e94"
server_key_iv: "7260967e07a7ddde8b1bff1d302b36fc"
server_key_version: "encryptionkey@0"
I20260807 15:20:10.787660 22603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "5c72dee69e0b42e98e8e55231ce61c99"
format_stamp: "Formatted at 2026-08-07 15:20:10 on dist-test-slave-g170"
server_key: "f703c9e004cc9349e66e6788c22d2e94"
server_key_iv: "7260967e07a7ddde8b1bff1d302b36fc"
server_key_version: "encryptionkey@0"
I20260807 15:20:10.791569 22603 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:20:10.794368 22618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:10.795761 22603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:20:10.795912 22603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "5c72dee69e0b42e98e8e55231ce61c99"
format_stamp: "Formatted at 2026-08-07 15:20:10 on dist-test-slave-g170"
server_key: "f703c9e004cc9349e66e6788c22d2e94"
server_key_iv: "7260967e07a7ddde8b1bff1d302b36fc"
server_key_version: "encryptionkey@0"
I20260807 15:20:10.796044 22603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:10.815266 22603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:10.818900 22603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:10.819103 22603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:10.828011 22603 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:41443
I20260807 15:20:10.828413 22702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:41443 every 8 connection(s)
I20260807 15:20:10.828878 22603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:10.832190 22703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:10.836979 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 22603
I20260807 15:20:10.837146 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:10.837419 16331 external_mini_cluster.cc:1428] Setting key dd29e3ca2ee6b963cc444da2e80704be
I20260807 15:20:10.838435 22703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99: Bootstrap starting.
I20260807 15:20:10.841344 22703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:10.842288 22703 log.cc:824] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:10.844568 22703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99: No bootstrap required, opened a new log
Aug 07 15:20:10 dist-test-slave-g170 krb5kdc[22581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:10.848776 22703 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c72dee69e0b42e98e8e55231ce61c99" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41443 } }
I20260807 15:20:10.849130 22703 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:10.849196 22703 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c72dee69e0b42e98e8e55231ce61c99, State: Initialized, Role: FOLLOWER
I20260807 15:20:10.849825 22703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c72dee69e0b42e98e8e55231ce61c99" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41443 } }
I20260807 15:20:10.850014 22703 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:10.850077 22703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:10.850193 22703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:10.851402 22703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c72dee69e0b42e98e8e55231ce61c99" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41443 } }
I20260807 15:20:10.851783 22703 leader_election.cc:302] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c72dee69e0b42e98e8e55231ce61c99; no voters:
I20260807 15:20:10.852157 22703 leader_election.cc:288] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:10.852257 22709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:10.852483 22709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [term 1 LEADER]: Becoming Leader. State: Replica: 5c72dee69e0b42e98e8e55231ce61c99, State: Running, Role: LEADER
I20260807 15:20:10.852895 22709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c72dee69e0b42e98e8e55231ce61c99" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41443 } }
I20260807 15:20:10.853621 22703 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:10.854744 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:10.839041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56150 (local address 127.15.242.254:41443)
0807 15:20:10.839501 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:10.839521 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:10.839568 (+ 47us) server_negotiation.cc:407] Connection header received
0807 15:20:10.840445 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:10.840469 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:10.840936 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:10.841337 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:10.842166 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:10.843562 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:10.844492 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:10.845231 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:10.845408 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:10.848080 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:10.848088 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:10.848111 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:10.848147 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:10.850511 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:10.851045 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:10.851054 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:10.851061 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:10.851224 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:10.851625 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:10.851628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:10.851629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:10.852184 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:10.853248 (+ 1064us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:10.853381 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 15:20:10.853719 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":126,"threads_started":1}
I20260807 15:20:10.854854 22712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c72dee69e0b42e98e8e55231ce61c99. Latest consensus state: current_term: 1 leader_uuid: "5c72dee69e0b42e98e8e55231ce61c99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c72dee69e0b42e98e8e55231ce61c99" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41443 } } }
I20260807 15:20:10.855176 22712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:10.855821 22723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:10.854856 22710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c72dee69e0b42e98e8e55231ce61c99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c72dee69e0b42e98e8e55231ce61c99" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41443 } } }
I20260807 15:20:10.856235 22710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:10.859251 22723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:10.865154 22723 catalog_manager.cc:1347] Generated new cluster ID: 09af5c16b8fa4f778849b0b12eb40631
I20260807 15:20:10.865243 22723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:10.873322 22723 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:10.874667 22723 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:10.893958 22723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99: Generated new TSK 0
I20260807 15:20:10.894909 22723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:20:10.929708 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41443
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:11.055035 22742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:11.055372 22742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:11.055462 22742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:11.059617 22742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:11.059711 22742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:11.059805 22742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:11.064994 22742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:11.066067 22742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:11.067186 22742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:11.077479 22750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:11.077618 22742 server_base.cc:1034] running on GCE node
W20260807 15:20:11.077533 22751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:11.077553 22754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:11.078341 22742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:11.079030 22742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:11.080227 22742 hybrid_clock.cc:648] HybridClock initialized: now 1786116011080206 us; error 33 us; skew 500 ppm
Aug 07 15:20:11 dist-test-slave-g170 krb5kdc[22581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116011, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:11.083279 22742 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:20:11.084084 22742 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:11.084153 22742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:11.084385 22742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:11.086529 22742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "cc6b13f72e1a4c67b3d2468f7c34c747"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "328ce4cf1e53e21f627cf7abc3c06663"
server_key_iv: "67608d9f045e9817866fee18999cb31e"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.087143 22742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "cc6b13f72e1a4c67b3d2468f7c34c747"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "328ce4cf1e53e21f627cf7abc3c06663"
server_key_iv: "67608d9f045e9817866fee18999cb31e"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.091013 22742 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:11.093492 22763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.094830 22742 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:20:11.094985 22742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "cc6b13f72e1a4c67b3d2468f7c34c747"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "328ce4cf1e53e21f627cf7abc3c06663"
server_key_iv: "67608d9f045e9817866fee18999cb31e"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.095089 22742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:11.122854 22742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:11.126344 22742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:11.126605 22742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:11.127326 22742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:11.128413 22742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:11.128476 22742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.128530 22742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:11.128587 22742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.139474 22742 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:42325
I20260807 15:20:11.139493 22933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:42325 every 8 connection(s)
I20260807 15:20:11.140172 22742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:11.148288 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 22742
I20260807 15:20:11.148480 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:11.148839 16331 external_mini_cluster.cc:1428] Setting key 18a6cee53479c8354856dd81e9ea4c49
Aug 07 15:20:11 dist-test-slave-g170 krb5kdc[22581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116011, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:11.156093 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.142104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:55041 (local address 127.15.242.254:41443)
0807 15:20:11.142283 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.142288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.143266 (+ 978us) server_negotiation.cc:407] Connection header received
0807 15:20:11.144696 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.144699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.144777 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.144859 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:11.146179 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.146715 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.148334 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.148815 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.148947 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.151975 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:11.151979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:11.151981 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:11.152004 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:11.153657 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:11.154395 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:11.154400 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:11.154402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:11.154486 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:11.154856 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:11.154859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:11.154861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:11.155121 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:11.155271 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.155780 (+ 509us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.155920 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 15:20:11.157011 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.142538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:41443 (local address 127.15.242.193:55041)
0807 15:20:11.143062 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:11.143112 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:11.144464 (+ 1352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:11.145067 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:11.145074 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:11.145491 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:11.146020 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.146034 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.147063 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.147066 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.148169 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.148183 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.149033 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.149038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.149272 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.150025 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:11.150045 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:11.151787 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:11.153867 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:11.153876 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:11.153897 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:11.154290 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:11.154593 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:11.154596 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:11.154598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:11.154749 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:11.155252 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:11.155262 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:11.155528 (+ 266us) client_negotiation.cc:769] Sending connection context
0807 15:20:11.155731 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 15:20:11.156073 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":132,"threads_started":1}
I20260807 15:20:11.158648 22934 heartbeater.cc:347] Connected to a master server at 127.15.242.254:41443
I20260807 15:20:11.158939 22934 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:11.159435 22934 heartbeater.cc:511] Master 127.15.242.254:41443 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:20:11.161273 22642 ts_manager.cc:194] Registered new tserver with Master: cc6b13f72e1a4c67b3d2468f7c34c747 (127.15.242.193:42325)
I20260807 15:20:11.162451 22642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:55041
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:20:11.180904 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41443
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:11.311321 22939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:11.311635 22939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:11.311688 22939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:11.316166 22939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:11.316231 22939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:11.316293 22939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:11.321997 22939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:11.323136 22939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:11.324165 22939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:20:11.334427 22939 server_base.cc:1034] running on GCE node
W20260807 15:20:11.334396 22950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:11.334396 22952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:11.334448 22954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:11.335108 22939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:11.335822 22939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:11.337007 22939 hybrid_clock.cc:648] HybridClock initialized: now 1786116011336984 us; error 32 us; skew 500 ppm
Aug 07 15:20:11 dist-test-slave-g170 krb5kdc[22581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116011, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:11.340271 22939 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:20:11.341209 22939 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:11.341292 22939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:11.341542 22939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:11.343822 22939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "5e47367bbdb84e5faadc9d266ec23868"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "acd3750e93f0250e3da46bebaa7dbea0"
server_key_iv: "0c4d46a26f868c37a5edbb63a510562b"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.344458 22939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "5e47367bbdb84e5faadc9d266ec23868"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "acd3750e93f0250e3da46bebaa7dbea0"
server_key_iv: "0c4d46a26f868c37a5edbb63a510562b"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.348693 22939 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:20:11.351579 22962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.353067 22939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 15:20:11.353205 22939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "5e47367bbdb84e5faadc9d266ec23868"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "acd3750e93f0250e3da46bebaa7dbea0"
server_key_iv: "0c4d46a26f868c37a5edbb63a510562b"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.353374 22939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:11.388170 22939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:11.391981 22939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:11.392269 22939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:11.393011 22939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:11.394140 22939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:11.394229 22939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.394315 22939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:11.394356 22939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.405290 22939 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:46373
I20260807 15:20:11.405318 23137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:46373 every 8 connection(s)
I20260807 15:20:11.405987 22939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:11.409571 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 22939
I20260807 15:20:11.409724 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:11.410022 16331 external_mini_cluster.cc:1428] Setting key 86f95f24b9da0f24178e41c18057948a
Aug 07 15:20:11 dist-test-slave-g170 krb5kdc[22581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116011, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:20:11.422045 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.408038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:34109 (local address 127.15.242.254:41443)
0807 15:20:11.408205 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.408210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.409236 (+ 1026us) server_negotiation.cc:407] Connection header received
0807 15:20:11.410861 (+ 1625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.410867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.410930 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.411026 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:11.412526 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.413150 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.414345 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.414571 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.414698 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.417670 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:11.417675 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:11.417680 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:11.417714 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:11.419587 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:11.420159 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:11.420169 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:11.420171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:11.420282 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:11.420793 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:11.420797 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:11.420798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:11.421049 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:11.421182 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.421715 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.421845 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 15:20:11.423034 23141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.408472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:41443 (local address 127.15.242.194:34109)
0807 15:20:11.409069 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:11.409115 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:11.410606 (+ 1491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:11.411249 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:11.411258 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:11.411842 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:11.412365 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.412380 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.413294 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.413303 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.414203 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.414213 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.414747 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.414751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.414934 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.415540 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:11.415559 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:11.417466 (+ 1907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:11.419730 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:11.419736 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:11.419751 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:11.420030 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:11.420432 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:11.420436 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:11.420438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:11.420595 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:11.421188 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:11.421195 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:11.421449 (+ 254us) client_negotiation.cc:769] Sending connection context
0807 15:20:11.421619 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 15:20:11.422013 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":135,"threads_started":1}
I20260807 15:20:11.424450 23138 heartbeater.cc:347] Connected to a master server at 127.15.242.254:41443
I20260807 15:20:11.424702 23138 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:20:11.425297 23138 heartbeater.cc:511] Master 127.15.242.254:41443 requested a full tablet report, sending...
I20260807 15:20:11.426532 22642 ts_manager.cc:194] Registered new tserver with Master: 5e47367bbdb84e5faadc9d266ec23868 (127.15.242.194:46373)
I20260807 15:20:11.427143 22642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:34109
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:20:11.445441 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41443
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:11.566337 23145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:11.566586 23145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:11.566637 23145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:11.570667 23145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:11.570717 23145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:11.570775 23145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:11.575978 23145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41443
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:11.577030 23145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:11.578006 23145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:11.588481 23152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:11.588542 23145 server_base.cc:1034] running on GCE node
W20260807 15:20:11.588510 23157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:11.588485 23159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:11.589248 23145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:11.589982 23145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:11.591214 23145 hybrid_clock.cc:648] HybridClock initialized: now 1786116011591202 us; error 29 us; skew 500 ppm
Aug 07 15:20:11 dist-test-slave-g170 krb5kdc[22581](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116011, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:11.594645 23145 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:20:11.595527 23145 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:11.595683 23145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:11.595958 23145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:11.598384 23145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "6c0c47a924a344cca93633c19b68922d"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "73c7cd57bdb377679aafa419acfd40e1"
server_key_iv: "623d60040feb7effea8c01d85ea76010"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.599165 23145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "6c0c47a924a344cca93633c19b68922d"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "73c7cd57bdb377679aafa419acfd40e1"
server_key_iv: "623d60040feb7effea8c01d85ea76010"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.603547 23145 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 15:20:11.606428 23168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.607939 23145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:20:11.608109 23145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "6c0c47a924a344cca93633c19b68922d"
format_stamp: "Formatted at 2026-08-07 15:20:11 on dist-test-slave-g170"
server_key: "73c7cd57bdb377679aafa419acfd40e1"
server_key_iv: "623d60040feb7effea8c01d85ea76010"
server_key_version: "encryptionkey@0"
I20260807 15:20:11.608245 23145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:11.673538 23145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:11.677304 23145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:11.677529 23145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:11.678198 23145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:11.679149 23145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:11.679229 23145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.679297 23145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:11.679351 23145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:11.689198 23145 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:35593
I20260807 15:20:11.689265 23327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:35593 every 8 connection(s)
I20260807 15:20:11.689931 23145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:11.694518 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 23145
I20260807 15:20:11.694665 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:11.694972 16331 external_mini_cluster.cc:1428] Setting key 59ede77d97995d4db0858e3386d76acb
Aug 07 15:20:11 dist-test-slave-g170 krb5kdc[22581](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116011, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:11.705021 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.691939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:45969 (local address 127.15.242.254:41443)
0807 15:20:11.692099 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.692103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.693035 (+ 932us) server_negotiation.cc:407] Connection header received
0807 15:20:11.694510 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.694513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.694564 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.694688 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:11.696274 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.697036 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.698388 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.698614 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.698728 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.701540 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:11.701544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:11.701546 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:11.701574 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:11.702834 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:11.703368 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:11.703373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:11.703375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:11.703465 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:11.703852 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:11.703855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:11.703857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:11.704046 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:11.704164 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.704681 (+ 517us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.704842 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 15:20:11.705814 23331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.692321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:41443 (local address 127.15.242.195:45969)
0807 15:20:11.692878 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:11.692931 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:11.694203 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:11.694907 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:11.694914 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:11.695415 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:11.696114 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.696141 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.697214 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.697223 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.698232 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.698243 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.698781 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.698785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.698983 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.699650 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:11.699667 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:11.701366 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:11.702964 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:11.702970 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:11.702985 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:11.703246 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:11.703568 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:11.703571 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:11.703573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:11.703717 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:11.704179 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:11.704187 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:11.704436 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 15:20:11.704637 (+ 201us) client_negotiation.cc:240] Negotiation successful
0807 15:20:11.704991 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":128,"threads_started":1}
I20260807 15:20:11.707252 23328 heartbeater.cc:347] Connected to a master server at 127.15.242.254:41443
I20260807 15:20:11.707561 23328 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:11.708156 23328 heartbeater.cc:511] Master 127.15.242.254:41443 requested a full tablet report, sending...
I20260807 15:20:11.709338 22642 ts_manager.cc:194] Registered new tserver with Master: 6c0c47a924a344cca93633c19b68922d (127.15.242.195:35593)
I20260807 15:20:11.709914 22642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:45969
I20260807 15:20:11.721438 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:20:11.731807 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.723476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56158 (local address 127.15.242.254:41443)
0807 15:20:11.723621 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.723624 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.723818 (+ 194us) server_negotiation.cc:407] Connection header received
0807 15:20:11.723906 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.723909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.723951 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.724028 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:11.724886 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.725415 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.726269 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.726481 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.726575 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.727928 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:11.727932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:11.727934 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:11.727959 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:11.729672 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:11.730115 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:11.730118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:11.730119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:11.730217 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:11.730738 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:11.730743 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:11.730744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:11.731046 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:11.731162 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.731504 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.731680 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:20:11.735383 22642 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:20:11.738761 22642 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:11.754683 23356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.749376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:42325 (local address 127.0.0.1:60700)
0807 15:20:11.749660 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:11.749671 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:11.749794 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:11.750273 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:11.750276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:11.750290 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:11.750384 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.750390 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.751879 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.751882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.753127 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.753140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.754114 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.754118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.754244 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.754285 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 15:20:11.754399 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 15:20:11.754529 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"mutex_wait_us":41,"thread_start_us":90,"threads_started":1}
I20260807 15:20:11.755141 23350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.748080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:35593 (local address 127.0.0.1:44844)
0807 15:20:11.749101 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:11.749171 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:11.749305 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:11.750128 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:11.750131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:11.750154 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:11.750377 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.750385 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.751503 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.751509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.753431 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.753442 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.754757 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.754761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.754844 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.754865 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 15:20:11.754945 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 15:20:11.755015 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":887,"spinlock_wait_cycles":7168,"thread_start_us":80,"threads_started":1}
I20260807 15:20:11.755275 23354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.748552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47930 (local address 127.15.242.194:46373)
0807 15:20:11.749601 (+ 1049us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.749613 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.749633 (+ 20us) server_negotiation.cc:407] Connection header received
0807 15:20:11.749713 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.749717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.749889 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.750026 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:11.750422 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.751648 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.753299 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.754073 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.754209 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.754334 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.755000 (+ 666us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.755103 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":949,"thread_start_us":138,"threads_started":1}
I20260807 15:20:11.755383 23355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.749036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60700 (local address 127.15.242.193:42325)
0807 15:20:11.749514 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.749521 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.749784 (+ 263us) server_negotiation.cc:407] Connection header received
0807 15:20:11.749919 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.749923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.750128 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.750281 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:11.750477 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.751764 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.753348 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.753978 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.754127 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.754271 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.754441 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.754535 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":107,"threads_started":1}
I20260807 15:20:11.755750 23352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.748205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44844 (local address 127.15.242.195:35593)
0807 15:20:11.748930 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.748945 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.749458 (+ 513us) server_negotiation.cc:407] Connection header received
0807 15:20:11.749550 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.749556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.749775 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.749934 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:11.750540 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.751314 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.753572 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.754419 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.754531 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.754666 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.755472 (+ 806us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.755571 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":164,"threads_started":1}
I20260807 15:20:11.754892 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.748126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:46373 (local address 127.0.0.1:47930)
0807 15:20:11.749101 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:11.749158 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:11.749305 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:11.750048 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:11.750054 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:11.750080 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:11.750280 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.750289 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.751803 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.751809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.753140 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.753147 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.754406 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.754409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.754546 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.754570 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 15:20:11.754636 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 15:20:11.754745 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"mutex_wait_us":166,"spinlock_wait_cycles":4608,"thread_start_us":120,"threads_started":1}
I20260807 15:20:11.758435 22833 tablet_service.cc:1467] Processing CreateTablet for tablet 73db7dd2ea2445c3b0c9cb7f422f004a (DEFAULT_TABLE table=test-table [id=f7fb5600abaf4c14b5ee1131b2f7d548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:11.758925 23234 tablet_service.cc:1467] Processing CreateTablet for tablet 73db7dd2ea2445c3b0c9cb7f422f004a (DEFAULT_TABLE table=test-table [id=f7fb5600abaf4c14b5ee1131b2f7d548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:11.758926 23038 tablet_service.cc:1467] Processing CreateTablet for tablet 73db7dd2ea2445c3b0c9cb7f422f004a (DEFAULT_TABLE table=test-table [id=f7fb5600abaf4c14b5ee1131b2f7d548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:11.759639 22833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73db7dd2ea2445c3b0c9cb7f422f004a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:11.759974 23038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73db7dd2ea2445c3b0c9cb7f422f004a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:11.759981 23234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73db7dd2ea2445c3b0c9cb7f422f004a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:11.766589 23357 tablet_bootstrap.cc:492] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747: Bootstrap starting.
I20260807 15:20:11.767761 23360 tablet_bootstrap.cc:492] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Bootstrap starting.
I20260807 15:20:11.769049 23357 tablet_bootstrap.cc:654] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:11.769153 23359 tablet_bootstrap.cc:492] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Bootstrap starting.
I20260807 15:20:11.769860 23357 log.cc:824] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:11.770323 23360 tablet_bootstrap.cc:654] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:11.771190 23360 log.cc:824] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:11.771488 23359 tablet_bootstrap.cc:654] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:11.772498 23357 tablet_bootstrap.cc:492] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747: No bootstrap required, opened a new log
I20260807 15:20:11.772729 23357 ts_tablet_manager.cc:1397] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:20:11.772856 23359 log.cc:824] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:11.773510 23360 tablet_bootstrap.cc:492] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: No bootstrap required, opened a new log
I20260807 15:20:11.773692 23360 ts_tablet_manager.cc:1397] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.002s
I20260807 15:20:11.774547 23359 tablet_bootstrap.cc:492] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: No bootstrap required, opened a new log
I20260807 15:20:11.774672 23359 ts_tablet_manager.cc:1397] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:20:11.777537 23359 raft_consensus.cc:348] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.777837 23359 raft_consensus.cc:374] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:11.777923 23359 raft_consensus.cc:729] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0c47a924a344cca93633c19b68922d, State: Initialized, Role: FOLLOWER
I20260807 15:20:11.777758 23357 raft_consensus.cc:348] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.777758 23360 raft_consensus.cc:348] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.778017 23357 raft_consensus.cc:374] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:11.778127 23357 raft_consensus.cc:729] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc6b13f72e1a4c67b3d2468f7c34c747, State: Initialized, Role: FOLLOWER
I20260807 15:20:11.778523 23359 consensus_queue.cc:260] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.778606 23357 consensus_queue.cc:260] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.778017 23360 raft_consensus.cc:374] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:11.779248 23360 raft_consensus.cc:729] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e47367bbdb84e5faadc9d266ec23868, State: Initialized, Role: FOLLOWER
I20260807 15:20:11.779429 22934 heartbeater.cc:503] Master 127.15.242.254:41443 was elected leader, sending a full tablet report...
I20260807 15:20:11.779709 23357 ts_tablet_manager.cc:1428] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:20:11.779703 23359 ts_tablet_manager.cc:1428] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260807 15:20:11.779692 23360 consensus_queue.cc:260] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.780026 23328 heartbeater.cc:503] Master 127.15.242.254:41443 was elected leader, sending a full tablet report...
I20260807 15:20:11.780592 23138 heartbeater.cc:503] Master 127.15.242.254:41443 was elected leader, sending a full tablet report...
I20260807 15:20:11.780608 23360 ts_tablet_manager.cc:1428] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
W20260807 15:20:11.891853 22935 tablet.cc:2369] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:20:11.907389 23139 tablet.cc:2369] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:20:11.913213 23364 raft_consensus.cc:482] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:11.913501 23364 raft_consensus.cc:504] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.914937 23364 leader_election.cc:288] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e47367bbdb84e5faadc9d266ec23868 (127.15.242.194:46373), cc6b13f72e1a4c67b3d2468f7c34c747 (127.15.242.193:42325)
I20260807 15:20:11.920401 23331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.915191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:46373 (local address 127.15.242.195:52099)
0807 15:20:11.915405 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:11.915423 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:11.915534 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:11.915854 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:11.915858 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:11.915872 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:11.916031 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.916038 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.917265 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.917268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.918779 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.918791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.919832 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.919836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.919987 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.920033 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 15:20:11.920129 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 15:20:11.920230 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":186}
I20260807 15:20:11.920414 23355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.915412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:35013 (local address 127.15.242.193:42325)
0807 15:20:11.915567 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.915574 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.915874 (+ 300us) server_negotiation.cc:407] Connection header received
0807 15:20:11.915974 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.915977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.916023 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.916085 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:11.916400 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.917246 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.918943 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.919716 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.919831 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.919875 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.920192 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.920277 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:20:11.920414 23354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.915320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:52099 (local address 127.15.242.194:46373)
0807 15:20:11.915461 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.915468 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.915497 (+ 29us) server_negotiation.cc:407] Connection header received
0807 15:20:11.915665 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.915670 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.915731 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.915807 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:11.916218 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.917124 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.918943 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.919657 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.919813 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.919875 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.920192 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.920277 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:20:11.920410 23371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.915277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:42325 (local address 127.15.242.195:35013)
0807 15:20:11.915727 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:11.915739 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:11.915866 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:11.916140 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:11.916146 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:11.916170 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:11.916279 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.916284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.917374 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.917377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.918791 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:11.918798 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.919832 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.919836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:11.919984 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.920037 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 15:20:11.920129 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 15:20:11.920223 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":46,"thread_start_us":146,"threads_started":1}
I20260807 15:20:11.921303 22867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73db7dd2ea2445c3b0c9cb7f422f004a" candidate_uuid: "6c0c47a924a344cca93633c19b68922d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" is_pre_election: true
I20260807 15:20:11.921392 23069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73db7dd2ea2445c3b0c9cb7f422f004a" candidate_uuid: "6c0c47a924a344cca93633c19b68922d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e47367bbdb84e5faadc9d266ec23868" is_pre_election: true
I20260807 15:20:11.921749 22867 raft_consensus.cc:2454] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c0c47a924a344cca93633c19b68922d in term 0.
I20260807 15:20:11.921774 23069 raft_consensus.cc:2454] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c0c47a924a344cca93633c19b68922d in term 0.
I20260807 15:20:11.922370 23172 leader_election.cc:302] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5e47367bbdb84e5faadc9d266ec23868, 6c0c47a924a344cca93633c19b68922d, cc6b13f72e1a4c67b3d2468f7c34c747; no voters:
I20260807 15:20:11.922705 23364 raft_consensus.cc:2781] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:11.922806 23364 raft_consensus.cc:482] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:11.922876 23364 raft_consensus.cc:3037] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:11.923969 23364 raft_consensus.cc:504] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.924391 23364 leader_election.cc:288] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [CANDIDATE]: Term 1 election: Requested vote from peers 5e47367bbdb84e5faadc9d266ec23868 (127.15.242.194:46373), cc6b13f72e1a4c67b3d2468f7c34c747 (127.15.242.193:42325)
I20260807 15:20:11.924770 23069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73db7dd2ea2445c3b0c9cb7f422f004a" candidate_uuid: "6c0c47a924a344cca93633c19b68922d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e47367bbdb84e5faadc9d266ec23868"
I20260807 15:20:11.924855 22867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73db7dd2ea2445c3b0c9cb7f422f004a" candidate_uuid: "6c0c47a924a344cca93633c19b68922d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747"
I20260807 15:20:11.924960 22867 raft_consensus.cc:3037] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:11.924954 23069 raft_consensus.cc:3037] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:11.926329 23069 raft_consensus.cc:2454] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0c47a924a344cca93633c19b68922d in term 1.
I20260807 15:20:11.926329 22867 raft_consensus.cc:2454] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c0c47a924a344cca93633c19b68922d in term 1.
I20260807 15:20:11.926694 23170 leader_election.cc:302] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e47367bbdb84e5faadc9d266ec23868, 6c0c47a924a344cca93633c19b68922d; no voters:
I20260807 15:20:11.926903 23364 raft_consensus.cc:2781] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:11.927162 23364 raft_consensus.cc:686] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 1 LEADER]: Becoming Leader. State: Replica: 6c0c47a924a344cca93633c19b68922d, State: Running, Role: LEADER
I20260807 15:20:11.927579 23364 consensus_queue.cc:237] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } }
I20260807 15:20:11.931209 22642 catalog_manager.cc:5495] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c0c47a924a344cca93633c19b68922d (127.15.242.195). New cstate: current_term: 1 leader_uuid: "6c0c47a924a344cca93633c19b68922d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c0c47a924a344cca93633c19b68922d" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 } health_report { overall_health: UNKNOWN } } }
W20260807 15:20:11.940985 23330 tablet.cc:2369] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:20:11.947194 23352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:11.943463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44850 (local address 127.15.242.195:35593)
0807 15:20:11.943592 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:11.943596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:11.943610 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:11.943792 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:11.943795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:11.943851 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:11.943948 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:11.944299 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.944898 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.945811 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:11.946017 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:11.946094 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:11.946424 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:11.946834 (+ 410us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:11.946925 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:11.947037 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 15:20:11.947088 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 15:20:11.953670 22867 raft_consensus.cc:1261] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747 [term 1 FOLLOWER]: Refusing update from remote peer 6c0c47a924a344cca93633c19b68922d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:11.953671 23069 raft_consensus.cc:1261] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 1 FOLLOWER]: Refusing update from remote peer 6c0c47a924a344cca93633c19b68922d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:11.954520 23364 consensus_queue.cc:1035] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e47367bbdb84e5faadc9d266ec23868" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 46373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:11.954746 23372 consensus_queue.cc:1035] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc6b13f72e1a4c67b3d2468f7c34c747" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:11.963047 23379 mvcc.cc:205] Tried to move back new op lower bound from 7315931184953364480 to 7315931184858505216. Current Snapshot: MvccSnapshot[applied={T|T < 7315931184953364480}]
I20260807 15:20:11.965442 23381 mvcc.cc:205] Tried to move back new op lower bound from 7315931184953364480 to 7315931184858505216. Current Snapshot: MvccSnapshot[applied={T|T < 7315931184953364480}]
I20260807 15:20:11.972237 23380 mvcc.cc:205] Tried to move back new op lower bound from 7315931184953364480 to 7315931184858505216. Current Snapshot: MvccSnapshot[applied={T|T < 7315931184953364480 or (T in {7315931184953364480})}]
I20260807 15:20:11.978132 22640 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:11.978353 22640 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:11.981146 22640 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5c72dee69e0b42e98e8e55231ce61c99: Sending DeleteTablet for 3 replicas of tablet 73db7dd2ea2445c3b0c9cb7f422f004a
I20260807 15:20:11.982311 22833 tablet_service.cc:1514] Processing DeleteTablet for tablet 73db7dd2ea2445c3b0c9cb7f422f004a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:11 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:60700
I20260807 15:20:11.982311 23234 tablet_service.cc:1514] Processing DeleteTablet for tablet 73db7dd2ea2445c3b0c9cb7f422f004a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:11 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:44844
I20260807 15:20:11.982887 23398 tablet_replica.cc:330] T 73db7dd2ea2445c3b0c9cb7f422f004a P cc6b13f72e1a4c67b3d2468f7c34c747: stopping tablet replica
I20260807 15:20:11.982872 23038 tablet_service.cc:1514] Processing DeleteTablet for tablet 73db7dd2ea2445c3b0c9cb7f422f004a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:11 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:47930
I20260807 15:20:11.983137 23394 tablet_replica.cc:330] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: stopping tablet replica
I20260807 15:20:11.983285 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 22742
I20260807 15:20:11.983445 23399 tablet_replica.cc:330] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: stopping tablet replica
I20260807 15:20:11.983456 23394 raft_consensus.cc:2229] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:20:11.983786 23399 raft_consensus.cc:2229] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:11.983821 23394 raft_consensus.cc:2258] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:11.984156 23399 raft_consensus.cc:2258] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:11.987288 23394 ts_tablet_manager.cc:1905] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:11.987353 23399 ts_tablet_manager.cc:1905] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:11.990155 23394 ts_tablet_manager.cc:1918] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:11.990289 23394 log.cc:1196] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/73db7dd2ea2445c3b0c9cb7f422f004a
I20260807 15:20:11.990661 23394 ts_tablet_manager.cc:1939] T 73db7dd2ea2445c3b0c9cb7f422f004a P 6c0c47a924a344cca93633c19b68922d: Deleting consensus metadata
I20260807 15:20:11.991051 23399 ts_tablet_manager.cc:1918] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:11.991180 23399 log.cc:1196] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/73db7dd2ea2445c3b0c9cb7f422f004a
I20260807 15:20:11.991571 23399 ts_tablet_manager.cc:1939] T 73db7dd2ea2445c3b0c9cb7f422f004a P 5e47367bbdb84e5faadc9d266ec23868: Deleting consensus metadata
I20260807 15:20:11.991952 22621 catalog_manager.cc:4841] TS 6c0c47a924a344cca93633c19b68922d (127.15.242.195:35593): tablet 73db7dd2ea2445c3b0c9cb7f422f004a (table test-table [id=f7fb5600abaf4c14b5ee1131b2f7d548]) successfully deleted
I20260807 15:20:11.993112 22619 catalog_manager.cc:4841] TS 5e47367bbdb84e5faadc9d266ec23868 (127.15.242.194:46373): tablet 73db7dd2ea2445c3b0c9cb7f422f004a (table test-table [id=f7fb5600abaf4c14b5ee1131b2f7d548]) successfully deleted
W20260807 15:20:12.001546 22622 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:42325 (error 108)
I20260807 15:20:12.001823 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 22939
I20260807 15:20:12.004957 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.004638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:42325 (local address 127.0.0.1:60716)
0807 15:20:12.004768 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.004875 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:42325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 15:20:12.005173 22622 catalog_manager.cc:4584] TS cc6b13f72e1a4c67b3d2468f7c34c747 (127.15.242.193:42325): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 73db7dd2ea2445c3b0c9cb7f422f004a: Network error: Client connection negotiation failed: client connection to 127.15.242.193:42325: connect: Connection refused (error 111)
I20260807 15:20:12.015125 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 23145
I20260807 15:20:12.028316 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 22603
2026-08-07T15:20:12Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2838 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T15:20:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:12Z Disabled control of system clock
I20260807 15:20:12.069506 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38733
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:45971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 15:20:12.188918 23409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:12.189172 23409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:12.189209 23409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:12.193192 23409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:12.193245 23409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:12.193260 23409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:12.193279 23409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:12.193349 23409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:12.198187 23409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38733
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:12.199277 23409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:12.200672 23409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:12.209157 23421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:12.209183 23418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:12.209385 23409 server_base.cc:1034] running on GCE node
W20260807 15:20:12.209199 23417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:12.210085 23409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:12.211133 23409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:12.212306 23409 hybrid_clock.cc:648] HybridClock initialized: now 1786116012212279 us; error 43 us; skew 500 ppm
I20260807 15:20:12.214115 23409 webserver.cc:460] Webserver started at http://127.15.242.254:46845/ using document root <none> and password file <none>
I20260807 15:20:12.214689 23409 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:12.214756 23409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:12.214958 23409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:12.217059 23409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "17610c5d0c564561aaea77ee4cadb3fd"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "b16e5ffbc428c32acd7633cbca6a708c"
server_key_iv: "479e88ca1d70051a025f7c350e65f3ab"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.217573 23409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "17610c5d0c564561aaea77ee4cadb3fd"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "b16e5ffbc428c32acd7633cbca6a708c"
server_key_iv: "479e88ca1d70051a025f7c350e65f3ab"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.221186 23409 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:20:12.223678 23431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.225063 23409 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:20:12.225167 23409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "17610c5d0c564561aaea77ee4cadb3fd"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "b16e5ffbc428c32acd7633cbca6a708c"
server_key_iv: "479e88ca1d70051a025f7c350e65f3ab"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.225265 23409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:12.229766 23409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:12.230345 23409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:12.230480 23409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:12.237697 23409 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38733
I20260807 15:20:12.237731 23508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38733 every 8 connection(s)
I20260807 15:20:12.238656 23409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:12.241925 23509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:12.246433 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 23409
I20260807 15:20:12.246551 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:12.246872 16331 external_mini_cluster.cc:1428] Setting key 9b4475d1ee02e900e75c19e1e0405aa6
I20260807 15:20:12.248083 23509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd: Bootstrap starting.
I20260807 15:20:12.250387 23509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:12.251345 23509 log.cc:824] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:12.253356 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.248519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53596 (local address 127.15.242.254:38733)
0807 15:20:12.249217 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.249235 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.249273 (+ 38us) server_negotiation.cc:407] Connection header received
0807 15:20:12.249969 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.249986 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.250366 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.250742 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.251692 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.251699 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.251719 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.251735 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.251810 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.251835 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.251955 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.252153 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.252408 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":138,"threads_started":1}
I20260807 15:20:12.253705 23509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd: No bootstrap required, opened a new log
I20260807 15:20:12.257982 23509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17610c5d0c564561aaea77ee4cadb3fd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38733 } }
I20260807 15:20:12.258270 23509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:12.258347 23509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17610c5d0c564561aaea77ee4cadb3fd, State: Initialized, Role: FOLLOWER
I20260807 15:20:12.258760 23509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17610c5d0c564561aaea77ee4cadb3fd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38733 } }
I20260807 15:20:12.258917 23509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:12.258987 23509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:12.259064 23509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:12.259861 23509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17610c5d0c564561aaea77ee4cadb3fd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38733 } }
I20260807 15:20:12.260197 23509 leader_election.cc:302] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17610c5d0c564561aaea77ee4cadb3fd; no voters:
I20260807 15:20:12.260452 23509 leader_election.cc:288] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:12.260648 23515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:12.260947 23515 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [term 1 LEADER]: Becoming Leader. State: Replica: 17610c5d0c564561aaea77ee4cadb3fd, State: Running, Role: LEADER
I20260807 15:20:12.261297 23515 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17610c5d0c564561aaea77ee4cadb3fd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38733 } }
I20260807 15:20:12.261859 23509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:12.263115 23516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17610c5d0c564561aaea77ee4cadb3fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17610c5d0c564561aaea77ee4cadb3fd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38733 } } }
I20260807 15:20:12.263259 23516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:12.263646 23517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17610c5d0c564561aaea77ee4cadb3fd. Latest consensus state: current_term: 1 leader_uuid: "17610c5d0c564561aaea77ee4cadb3fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17610c5d0c564561aaea77ee4cadb3fd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38733 } } }
I20260807 15:20:12.264288 23517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:12.263841 23524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:12.267210 23524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:12.275135 23524 catalog_manager.cc:1347] Generated new cluster ID: 08d98cb779ca4dd58746c3a978fb5512
I20260807 15:20:12.275266 23524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:12.282253 23524 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:12.282560 23524 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:12.288700 23524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd: Generated new TSK 0
I20260807 15:20:12.289407 23524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:20:12.301244 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38733
--builtin_ntp_servers=127.15.242.212:45971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 15:20:12.424602 23544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:12.424932 23544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:12.425019 23544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:12.429051 23544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:12.429144 23544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:12.429255 23544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:12.434006 23544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:12.435096 23544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:12.436529 23544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:12.446532 23558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:12.446532 23556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:12.446553 23552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:12.446738 23544 server_base.cc:1034] running on GCE node
I20260807 15:20:12.447324 23544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:12.447978 23544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:12.449179 23544 hybrid_clock.cc:648] HybridClock initialized: now 1786116012449159 us; error 40 us; skew 500 ppm
I20260807 15:20:12.451131 23544 webserver.cc:460] Webserver started at http://127.15.242.193:45537/ using document root <none> and password file <none>
I20260807 15:20:12.451749 23544 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:12.451854 23544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:12.452104 23544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:12.454370 23544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "2493a8bca0814353bbd8594813da1a8a"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "5f6d5988080efdad96d00b42b36eecbc"
server_key_iv: "dcbd585e6bfca5bd8f06b9eeba14751e"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.454973 23544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "2493a8bca0814353bbd8594813da1a8a"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "5f6d5988080efdad96d00b42b36eecbc"
server_key_iv: "dcbd585e6bfca5bd8f06b9eeba14751e"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.458736 23544 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 15:20:12.461427 23566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.462855 23544 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:12.463016 23544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "2493a8bca0814353bbd8594813da1a8a"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "5f6d5988080efdad96d00b42b36eecbc"
server_key_iv: "dcbd585e6bfca5bd8f06b9eeba14751e"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.463169 23544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:12.468101 23544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:12.468811 23544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:12.469038 23544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:12.469643 23544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:12.470624 23544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:12.470711 23544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.470785 23544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:12.470847 23544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.481093 23544 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:33005
I20260807 15:20:12.481153 23746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:33005 every 8 connection(s)
I20260807 15:20:12.482103 23544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:12.489279 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 23544
I20260807 15:20:12.489383 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.484446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:38571 (local address 127.15.242.254:38733)
0807 15:20:12.484715 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.484719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.485938 (+ 1219us) server_negotiation.cc:407] Connection header received
0807 15:20:12.487458 (+ 1520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.487461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.487509 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.487620 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.488836 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.488840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.488843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.488859 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.488881 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.488891 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.489015 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.489197 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.489246 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260807 15:20:12.489459 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:12.489892 16331 external_mini_cluster.cc:1428] Setting key 754773a22224d787bcfa21689944c696
I20260807 15:20:12.490334 23749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.484995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38733 (local address 127.15.242.193:38571)
0807 15:20:12.485771 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.485813 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:12.487223 (+ 1410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:12.487804 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:12.487810 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:12.487899 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:12.488535 (+ 636us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:12.488537 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:12.488576 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:12.488654 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:12.489003 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:12.489013 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:12.489025 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 15:20:12.489231 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 15:20:12.489482 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":150,"threads_started":1}
I20260807 15:20:12.491544 23747 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38733
I20260807 15:20:12.491824 23747 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:12.492245 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38733
--builtin_ntp_servers=127.15.242.212:45971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 15:20:12.492348 23747 heartbeater.cc:511] Master 127.15.242.254:38733 requested a full tablet report, sending...
I20260807 15:20:12.494230 23458 ts_manager.cc:194] Registered new tserver with Master: 2493a8bca0814353bbd8594813da1a8a (127.15.242.193:33005)
W20260807 15:20:12.610530 23750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:12.610786 23750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:12.610826 23750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:12.614889 23750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:12.614938 23750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:12.615031 23750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:12.619941 23750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:12.621088 23750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:12.622501 23750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:12.632500 23757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:12.632529 23756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:12.632524 23759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:12.632980 23750 server_base.cc:1034] running on GCE node
I20260807 15:20:12.633320 23750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:12.633920 23750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:12.635115 23750 hybrid_clock.cc:648] HybridClock initialized: now 1786116012635101 us; error 29 us; skew 500 ppm
I20260807 15:20:12.637284 23750 webserver.cc:460] Webserver started at http://127.15.242.194:39761/ using document root <none> and password file <none>
I20260807 15:20:12.637892 23750 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:12.637956 23750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:12.638190 23750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:12.640506 23750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "94b58af004084848b8a1866ac7ba9e6e"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "12bfcce7a955855bc9349ed600b55b64"
server_key_iv: "e311303f1e8199bf2a1bb38db20351f5"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.641384 23750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "94b58af004084848b8a1866ac7ba9e6e"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "12bfcce7a955855bc9349ed600b55b64"
server_key_iv: "e311303f1e8199bf2a1bb38db20351f5"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.645648 23750 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:20:12.648360 23772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.649885 23750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:12.650038 23750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "94b58af004084848b8a1866ac7ba9e6e"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "12bfcce7a955855bc9349ed600b55b64"
server_key_iv: "e311303f1e8199bf2a1bb38db20351f5"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.650179 23750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:12.655426 23750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:12.656071 23750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:12.656270 23750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:12.656900 23750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:12.657843 23750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:12.657929 23750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.657997 23750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:12.658051 23750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.668612 23750 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:33839
I20260807 15:20:12.668638 23936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:33839 every 8 connection(s)
I20260807 15:20:12.669607 23750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:12.670159 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 23750
I20260807 15:20:12.670305 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:12.670624 16331 external_mini_cluster.cc:1428] Setting key 3895e6cd837faf71e31eb4fc2a9f714e
I20260807 15:20:12.672986 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38733
--builtin_ntp_servers=127.15.242.212:45971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 15:20:12.677506 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.671773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:40687 (local address 127.15.242.254:38733)
0807 15:20:12.671920 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.671924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.673348 (+ 1424us) server_negotiation.cc:407] Connection header received
0807 15:20:12.675380 (+ 2032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.675386 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.675442 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.675544 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.676928 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.676935 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.676941 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.676960 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.676987 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.677001 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.677113 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.677255 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.677309 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 15:20:12.678386 23939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.672311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38733 (local address 127.15.242.194:40687)
0807 15:20:12.673177 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.673235 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:12.675134 (+ 1899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:12.675721 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:12.675729 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:12.675861 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:12.676585 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:12.676587 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:12.676631 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:12.676707 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:12.677099 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:12.677107 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:12.677111 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 15:20:12.677259 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 15:20:12.677469 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":108,"threads_started":1}
I20260807 15:20:12.679744 23937 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38733
I20260807 15:20:12.680049 23937 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:12.680505 23937 heartbeater.cc:511] Master 127.15.242.254:38733 requested a full tablet report, sending...
I20260807 15:20:12.681728 23458 ts_manager.cc:194] Registered new tserver with Master: 94b58af004084848b8a1866ac7ba9e6e (127.15.242.194:33839)
W20260807 15:20:12.795742 23940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:12.796015 23940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:12.796056 23940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:12.800225 23940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:12.800287 23940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:12.800344 23940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:12.805253 23940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:12.806277 23940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:12.807600 23940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:12.817502 23945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:12.817590 23940 server_base.cc:1034] running on GCE node
W20260807 15:20:12.817502 23949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:12.817533 23951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:12.818270 23940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:12.818936 23940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:12.820127 23940 hybrid_clock.cc:648] HybridClock initialized: now 1786116012820107 us; error 30 us; skew 500 ppm
I20260807 15:20:12.822233 23940 webserver.cc:460] Webserver started at http://127.15.242.195:41937/ using document root <none> and password file <none>
I20260807 15:20:12.822852 23940 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:12.822917 23940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:12.823155 23940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:12.825496 23940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "0875655cba2e41899a3834393ced202c"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "1d4c4b5ec54c08e4460d9e87a04bfc1b"
server_key_iv: "01bc37c83533b380ce55d9edba46f680"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.826097 23940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "0875655cba2e41899a3834393ced202c"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "1d4c4b5ec54c08e4460d9e87a04bfc1b"
server_key_iv: "01bc37c83533b380ce55d9edba46f680"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.830215 23940 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260807 15:20:12.833041 23962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.834463 23940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:20:12.834633 23940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "0875655cba2e41899a3834393ced202c"
format_stamp: "Formatted at 2026-08-07 15:20:12 on dist-test-slave-g170"
server_key: "1d4c4b5ec54c08e4460d9e87a04bfc1b"
server_key_iv: "01bc37c83533b380ce55d9edba46f680"
server_key_version: "encryptionkey@0"
I20260807 15:20:12.834779 23940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:12.839695 23940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:12.840343 23940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:12.840541 23940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:12.841200 23940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:12.842183 23940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:12.842260 23940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.842324 23940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:12.842360 23940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:12.851893 23940 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:44899
I20260807 15:20:12.851918 24126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:44899 every 8 connection(s)
I20260807 15:20:12.852918 23940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:12.859719 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.855180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:35621 (local address 127.15.242.254:38733)
0807 15:20:12.855333 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.855337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.856460 (+ 1123us) server_negotiation.cc:407] Connection header received
0807 15:20:12.857956 (+ 1496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.857959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.858004 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.858119 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.859206 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.859217 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.859220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.859232 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.859258 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.859266 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.859368 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.859522 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.859567 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:20:12.860632 24129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.855615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38733 (local address 127.15.242.195:35621)
0807 15:20:12.856301 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.856340 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:12.857697 (+ 1357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:12.858286 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:12.858292 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:12.858396 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:12.858939 (+ 543us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:12.858940 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:12.858980 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:12.859047 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:12.859353 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:12.859363 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:12.859369 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 15:20:12.859564 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 15:20:12.859881 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":126,"threads_started":1}
I20260807 15:20:12.861768 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 23940
I20260807 15:20:12.861872 24127 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38733
I20260807 15:20:12.861912 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:12.862115 24127 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:12.862246 16331 external_mini_cluster.cc:1428] Setting key 37666174ef6622ce6c27b4ad8a61d631
I20260807 15:20:12.862654 24127 heartbeater.cc:511] Master 127.15.242.254:38733 requested a full tablet report, sending...
I20260807 15:20:12.863991 23457 ts_manager.cc:194] Registered new tserver with Master: 0875655cba2e41899a3834393ced202c (127.15.242.195:44899)
I20260807 15:20:12.876332 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:20:12.880509 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.878623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53608 (local address 127.15.242.254:38733)
0807 15:20:12.878855 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.878861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.878971 (+ 110us) server_negotiation.cc:407] Connection header received
0807 15:20:12.879145 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.879149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.879196 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.879298 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.880041 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.880045 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.880048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.880060 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.880088 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.880096 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.880194 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.880330 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.880374 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260807 15:20:12.883563 23457 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53608:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:20:12.886655 23457 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:12.898662 24143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.895214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:33839 (local address 127.0.0.1:53318)
0807 15:20:12.896323 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.896378 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:12.896483 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:12.897038 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:12.897045 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:12.897126 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:12.897734 (+ 608us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:12.897736 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:12.897758 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:12.897827 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:12.898286 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:12.898296 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:12.898302 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 15:20:12.898451 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 15:20:12.898526 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":61,"threads_started":1}
I20260807 15:20:12.899111 24151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.896054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53318 (local address 127.15.242.194:33839)
0807 15:20:12.896539 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.896551 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.896575 (+ 24us) server_negotiation.cc:407] Connection header received
0807 15:20:12.896629 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.896634 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.896853 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.897006 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.898012 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.898024 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.898036 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.898049 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.898097 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.898129 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.898240 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.898885 (+ 645us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.898966 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":135,"threads_started":1}
I20260807 15:20:12.899864 24144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.895514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:33005 (local address 127.0.0.1:33250)
0807 15:20:12.896981 (+ 1467us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.896995 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:12.897073 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:12.897926 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:12.897929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:12.897945 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:12.898399 (+ 454us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:12.898403 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:12.898417 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:12.898445 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:12.899611 (+ 1166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:12.899614 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:12.899617 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 15:20:12.899698 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 15:20:12.899733 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1393,"thread_start_us":127,"threads_started":1}
I20260807 15:20:12.900269 24146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.895248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44899 (local address 127.0.0.1:39908)
0807 15:20:12.896924 (+ 1676us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.896965 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:12.897121 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:12.898203 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:12.898208 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:12.898228 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:12.898689 (+ 461us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:12.898691 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:12.898703 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:12.898734 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:12.899183 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:12.899186 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:12.899188 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 15:20:12.900108 (+ 920us) client_negotiation.cc:240] Negotiation successful
0807 15:20:12.900144 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1603,"thread_start_us":105,"threads_started":1}
I20260807 15:20:12.900303 24153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.896067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33250 (local address 127.15.242.193:33005)
0807 15:20:12.896800 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.896816 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.897169 (+ 353us) server_negotiation.cc:407] Connection header received
0807 15:20:12.897230 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.897236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.897780 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.897937 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.899355 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.899362 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.899377 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.899387 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.899423 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.899448 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.899561 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.900079 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.900159 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":176,"threads_started":1}
I20260807 15:20:12.900689 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.895506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39908 (local address 127.15.242.195:44899)
0807 15:20:12.896227 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.896243 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.897066 (+ 823us) server_negotiation.cc:407] Connection header received
0807 15:20:12.897265 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.897273 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.897458 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.897592 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.898891 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.898900 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.898914 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.898928 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.898979 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.899016 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.899105 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.900519 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.900576 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":235,"threads_started":1}
I20260807 15:20:12.902086 23839 tablet_service.cc:1467] Processing CreateTablet for tablet 869a6f668bf4424dbe08997777e2b99a (DEFAULT_TABLE table=test-table [id=a4486b24399d4fb38b11bc127091ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:12.903326 23839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 869a6f668bf4424dbe08997777e2b99a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:12.903059 24038 tablet_service.cc:1467] Processing CreateTablet for tablet 869a6f668bf4424dbe08997777e2b99a (DEFAULT_TABLE table=test-table [id=a4486b24399d4fb38b11bc127091ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:12.904018 24038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 869a6f668bf4424dbe08997777e2b99a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:12.905442 23639 tablet_service.cc:1467] Processing CreateTablet for tablet 869a6f668bf4424dbe08997777e2b99a (DEFAULT_TABLE table=test-table [id=a4486b24399d4fb38b11bc127091ab4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:12.906482 23639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 869a6f668bf4424dbe08997777e2b99a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:12.910122 24155 tablet_bootstrap.cc:492] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: Bootstrap starting.
I20260807 15:20:12.911761 24156 tablet_bootstrap.cc:492] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: Bootstrap starting.
I20260807 15:20:12.912861 24155 tablet_bootstrap.cc:654] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:12.913735 24155 log.cc:824] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:12.913951 24156 tablet_bootstrap.cc:654] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:12.913946 24157 tablet_bootstrap.cc:492] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a: Bootstrap starting.
I20260807 15:20:12.914805 24156 log.cc:824] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:12.915949 24155 tablet_bootstrap.cc:492] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: No bootstrap required, opened a new log
I20260807 15:20:12.916170 24155 ts_tablet_manager.cc:1397] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 15:20:12.916188 24157 tablet_bootstrap.cc:654] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:12.916615 24156 tablet_bootstrap.cc:492] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: No bootstrap required, opened a new log
I20260807 15:20:12.916848 24156 ts_tablet_manager.cc:1397] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 15:20:12.917040 24157 log.cc:824] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:12.919392 24157 tablet_bootstrap.cc:492] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a: No bootstrap required, opened a new log
I20260807 15:20:12.919641 24157 ts_tablet_manager.cc:1397] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:20:12.920738 24156 raft_consensus.cc:348] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.921041 24156 raft_consensus.cc:374] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:12.921097 24156 raft_consensus.cc:729] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94b58af004084848b8a1866ac7ba9e6e, State: Initialized, Role: FOLLOWER
I20260807 15:20:12.920902 24155 raft_consensus.cc:348] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.921187 24155 raft_consensus.cc:374] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:12.921252 24155 raft_consensus.cc:729] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0875655cba2e41899a3834393ced202c, State: Initialized, Role: FOLLOWER
I20260807 15:20:12.921568 24156 consensus_queue.cc:260] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.921725 24155 consensus_queue.cc:260] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.922253 23937 heartbeater.cc:503] Master 127.15.242.254:38733 was elected leader, sending a full tablet report...
I20260807 15:20:12.922601 24156 ts_tablet_manager.cc:1428] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:20:12.922777 24155 ts_tablet_manager.cc:1428] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260807 15:20:12.923177 24127 heartbeater.cc:503] Master 127.15.242.254:38733 was elected leader, sending a full tablet report...
I20260807 15:20:12.924304 24157 raft_consensus.cc:348] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.924573 24157 raft_consensus.cc:374] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:12.924625 24157 raft_consensus.cc:729] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2493a8bca0814353bbd8594813da1a8a, State: Initialized, Role: FOLLOWER
I20260807 15:20:12.925105 24157 consensus_queue.cc:260] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.925989 23747 heartbeater.cc:503] Master 127.15.242.254:38733 was elected leader, sending a full tablet report...
I20260807 15:20:12.926105 24157 ts_tablet_manager.cc:1428] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
W20260807 15:20:12.983371 23748 tablet.cc:2369] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:20:12.985633 24164 raft_consensus.cc:482] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:12.985852 24164 raft_consensus.cc:504] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.987002 24164 leader_election.cc:288] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94b58af004084848b8a1866ac7ba9e6e (127.15.242.194:33839), 0875655cba2e41899a3834393ced202c (127.15.242.195:44899)
I20260807 15:20:12.989177 23749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.987296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:33839 (local address 127.15.242.193:50173)
0807 15:20:12.987448 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.987466 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:12.987559 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:12.987875 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:12.987878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:12.987892 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:12.988479 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:12.988484 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:12.988499 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:12.988533 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:12.988871 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:12.988875 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:12.988879 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 15:20:12.988975 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 15:20:12.989018 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 15:20:12.989212 24151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.987415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:50173 (local address 127.15.242.194:33839)
0807 15:20:12.987547 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.987552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.987570 (+ 18us) server_negotiation.cc:407] Connection header received
0807 15:20:12.987703 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.987706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.987749 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.987843 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.988686 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.988690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.988693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.988706 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.988728 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.988738 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.988866 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.988987 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.989054 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 15:20:12.989367 24166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.987307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44899 (local address 127.15.242.193:44827)
0807 15:20:12.987853 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:12.987869 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:12.987964 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:12.988182 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:12.988185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:12.988199 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:12.988653 (+ 454us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:12.988656 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:12.988716 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:12.988744 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:12.989045 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:12.989049 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:12.989052 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 15:20:12.989136 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 15:20:12.989169 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":159,"thread_start_us":122,"threads_started":1}
I20260807 15:20:12.989369 24149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:12.987444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:44827 (local address 127.15.242.195:44899)
0807 15:20:12.987571 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:12.987575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:12.987970 (+ 395us) server_negotiation.cc:407] Connection header received
0807 15:20:12.988026 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:12.988030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:12.988080 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:12.988186 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:12.988890 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:12.988894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:12.988896 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:12.988912 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:12.988938 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:12.988951 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:12.989039 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:12.989158 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 15:20:12.989237 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 15:20:12.990147 23873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "869a6f668bf4424dbe08997777e2b99a" candidate_uuid: "2493a8bca0814353bbd8594813da1a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94b58af004084848b8a1866ac7ba9e6e" is_pre_election: true
I20260807 15:20:12.990175 24068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "869a6f668bf4424dbe08997777e2b99a" candidate_uuid: "2493a8bca0814353bbd8594813da1a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0875655cba2e41899a3834393ced202c" is_pre_election: true
I20260807 15:20:12.990463 23873 raft_consensus.cc:2454] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2493a8bca0814353bbd8594813da1a8a in term 0.
I20260807 15:20:12.990481 24068 raft_consensus.cc:2454] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2493a8bca0814353bbd8594813da1a8a in term 0.
I20260807 15:20:12.990964 23572 leader_election.cc:302] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2493a8bca0814353bbd8594813da1a8a, 94b58af004084848b8a1866ac7ba9e6e; no voters:
I20260807 15:20:12.991261 24164 raft_consensus.cc:2781] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:12.991415 24164 raft_consensus.cc:482] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:12.991495 24164 raft_consensus.cc:3037] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:12.992708 24164 raft_consensus.cc:504] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.993126 24164 leader_election.cc:288] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [CANDIDATE]: Term 1 election: Requested vote from peers 94b58af004084848b8a1866ac7ba9e6e (127.15.242.194:33839), 0875655cba2e41899a3834393ced202c (127.15.242.195:44899)
I20260807 15:20:12.993495 23873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "869a6f668bf4424dbe08997777e2b99a" candidate_uuid: "2493a8bca0814353bbd8594813da1a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94b58af004084848b8a1866ac7ba9e6e"
I20260807 15:20:12.993621 24068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "869a6f668bf4424dbe08997777e2b99a" candidate_uuid: "2493a8bca0814353bbd8594813da1a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0875655cba2e41899a3834393ced202c"
I20260807 15:20:12.993628 23873 raft_consensus.cc:3037] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:12.993789 24068 raft_consensus.cc:3037] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:12.994766 23873 raft_consensus.cc:2454] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2493a8bca0814353bbd8594813da1a8a in term 1.
I20260807 15:20:12.994983 24068 raft_consensus.cc:2454] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2493a8bca0814353bbd8594813da1a8a in term 1.
I20260807 15:20:12.995112 23572 leader_election.cc:302] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2493a8bca0814353bbd8594813da1a8a, 94b58af004084848b8a1866ac7ba9e6e; no voters:
I20260807 15:20:12.995288 24164 raft_consensus.cc:2781] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:12.995538 24164 raft_consensus.cc:686] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [term 1 LEADER]: Becoming Leader. State: Replica: 2493a8bca0814353bbd8594813da1a8a, State: Running, Role: LEADER
I20260807 15:20:12.995895 24164 consensus_queue.cc:237] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } }
I20260807 15:20:12.999375 23456 catalog_manager.cc:5495] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2493a8bca0814353bbd8594813da1a8a (127.15.242.193). New cstate: current_term: 1 leader_uuid: "2493a8bca0814353bbd8594813da1a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2493a8bca0814353bbd8594813da1a8a" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 33005 } health_report { overall_health: HEALTHY } } }
I20260807 15:20:13.023449 24153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:13.021627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33266 (local address 127.15.242.193:33005)
0807 15:20:13.021794 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:13.021799 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:13.021816 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:20:13.021956 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:13.021959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:13.022026 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:13.022151 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:13.022984 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:13.022988 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:13.022991 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:13.023005 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:13.023035 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:13.023044 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:13.023156 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:13.023239 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 15:20:13.023288 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 15:20:13.031090 23873 raft_consensus.cc:1261] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 1 FOLLOWER]: Refusing update from remote peer 2493a8bca0814353bbd8594813da1a8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:13.031137 24068 raft_consensus.cc:1261] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 1 FOLLOWER]: Refusing update from remote peer 2493a8bca0814353bbd8594813da1a8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:13.031934 24167 consensus_queue.cc:1035] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0875655cba2e41899a3834393ced202c" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:13.032140 24164 consensus_queue.cc:1035] T 869a6f668bf4424dbe08997777e2b99a P 2493a8bca0814353bbd8594813da1a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "94b58af004084848b8a1866ac7ba9e6e" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:13.039155 24174 mvcc.cc:205] Tried to move back new op lower bound from 7315931189367296000 to 7315931189233754112. Current Snapshot: MvccSnapshot[applied={T|T < 7315931189367296000}]
I20260807 15:20:13.041356 24175 mvcc.cc:205] Tried to move back new op lower bound from 7315931189367296000 to 7315931189233754112. Current Snapshot: MvccSnapshot[applied={T|T < 7315931189367296000}]
I20260807 15:20:13.049952 23457 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:13.050179 23457 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:13.053318 23457 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 17610c5d0c564561aaea77ee4cadb3fd: Sending DeleteTablet for 3 replicas of tablet 869a6f668bf4424dbe08997777e2b99a
I20260807 15:20:13.054313 24038 tablet_service.cc:1514] Processing DeleteTablet for tablet 869a6f668bf4424dbe08997777e2b99a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:13 UTC) from {username='slave'} at 127.0.0.1:39908
I20260807 15:20:13.054495 23639 tablet_service.cc:1514] Processing DeleteTablet for tablet 869a6f668bf4424dbe08997777e2b99a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:13 UTC) from {username='slave'} at 127.0.0.1:33250
I20260807 15:20:13.054947 24190 tablet_replica.cc:330] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: stopping tablet replica
I20260807 15:20:13.054926 23839 tablet_service.cc:1514] Processing DeleteTablet for tablet 869a6f668bf4424dbe08997777e2b99a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:13 UTC) from {username='slave'} at 127.0.0.1:53318
I20260807 15:20:13.055476 24193 tablet_replica.cc:330] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: stopping tablet replica
I20260807 15:20:13.055516 24190 raft_consensus.cc:2229] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:13.055789 24193 raft_consensus.cc:2229] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:13.055974 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 23544
I20260807 15:20:13.056058 24193 raft_consensus.cc:2258] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:13.056074 24190 raft_consensus.cc:2258] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:13.066035 24190 ts_tablet_manager.cc:1905] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:13.066061 24193 ts_tablet_manager.cc:1905] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:13.068390 24190 ts_tablet_manager.cc:1918] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:13.068526 24190 log.cc:1196] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/869a6f668bf4424dbe08997777e2b99a
I20260807 15:20:13.068907 24190 ts_tablet_manager.cc:1939] T 869a6f668bf4424dbe08997777e2b99a P 0875655cba2e41899a3834393ced202c: Deleting consensus metadata
I20260807 15:20:13.069752 24193 ts_tablet_manager.cc:1918] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:13.069881 24193 log.cc:1196] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/869a6f668bf4424dbe08997777e2b99a
I20260807 15:20:13.070252 24193 ts_tablet_manager.cc:1939] T 869a6f668bf4424dbe08997777e2b99a P 94b58af004084848b8a1866ac7ba9e6e: Deleting consensus metadata
I20260807 15:20:13.070279 23438 catalog_manager.cc:4841] TS 0875655cba2e41899a3834393ced202c (127.15.242.195:44899): tablet 869a6f668bf4424dbe08997777e2b99a (table test-table [id=a4486b24399d4fb38b11bc127091ab4b]) successfully deleted
I20260807 15:20:13.071631 23442 catalog_manager.cc:4841] TS 94b58af004084848b8a1866ac7ba9e6e (127.15.242.194:33839): tablet 869a6f668bf4424dbe08997777e2b99a (table test-table [id=a4486b24399d4fb38b11bc127091ab4b]) successfully deleted
I20260807 15:20:13.073527 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 23750
W20260807 15:20:13.073544 23439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:33005 (error 108)
I20260807 15:20:13.076711 24146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:13.076348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:33005 (local address 127.0.0.1:33280)
0807 15:20:13.076542 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:13.076615 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:33005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260807 15:20:13.076889 23439 catalog_manager.cc:4584] TS 2493a8bca0814353bbd8594813da1a8a (127.15.242.193:33005): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 869a6f668bf4424dbe08997777e2b99a: Network error: Client connection negotiation failed: client connection to 127.15.242.193:33005: connect: Connection refused (error 111)
I20260807 15:20:13.090427 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 23940
I20260807 15:20:13.104099 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 23409
2026-08-07T15:20:13Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1077 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 15:20:13.137673 16331 mini_oidc.cc:152] Starting JWKS server
I20260807 15:20:13.139273 16331 webserver.cc:460] Webserver started at https://127.0.0.1:43897/ using document root <none> and password file <none>
I20260807 15:20:13.139418 16331 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 15:20:13.139652 16331 webserver.cc:460] Webserver started at http://127.0.0.1:32889/ using document root <none> and password file <none>
2026-08-07T15:20:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:13Z Disabled control of system clock
I20260807 15:20:13.150596 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:33297
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:37217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:33297
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43897/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/testchainca.cert with env {}
W20260807 15:20:13.266474 24204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:13.266744 24204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:13.266783 24204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:13.270944 24204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:13.271003 24204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:13.271018 24204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:13.271034 24204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:13.271050 24204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 15:20:13.271065 24204 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 15:20:13.271080 24204 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43897/jwks.json
I20260807 15:20:13.276985 24204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:33297
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:33297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43897/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:13.278008 24204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:13.279040 24204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:13.287761 24212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:13.287890 24211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:13.287806 24214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:13.288003 24204 server_base.cc:1034] running on GCE node
I20260807 15:20:13.288570 24204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:13.289775 24204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:13.290989 24204 hybrid_clock.cc:648] HybridClock initialized: now 1786116013290956 us; error 45 us; skew 500 ppm
I20260807 15:20:13.293049 24204 webserver.cc:460] Webserver started at http://127.15.242.254:34085/ using document root <none> and password file <none>
I20260807 15:20:13.293671 24204 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:13.293771 24204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:13.294031 24204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:13.296277 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "0279768e961d4f06a957ff5c1d87e5dc"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "72834154b4f9f8a95220ba574d59feb7"
server_key_iv: "d035b6292fdae6a36a7e60ab75736ecd"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.296962 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "0279768e961d4f06a957ff5c1d87e5dc"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "72834154b4f9f8a95220ba574d59feb7"
server_key_iv: "d035b6292fdae6a36a7e60ab75736ecd"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.300976 24204 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:20:13.303922 24222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:13.305371 24204 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:13.305536 24204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "0279768e961d4f06a957ff5c1d87e5dc"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "72834154b4f9f8a95220ba574d59feb7"
server_key_iv: "d035b6292fdae6a36a7e60ab75736ecd"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.305716 24204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:13.320619 24204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:13.321496 24204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:13.321745 24204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:13.329874 24204 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:33297
I20260807 15:20:13.329877 24297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:33297 every 8 connection(s)
I20260807 15:20:13.330945 24204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:13.334359 24300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:13.337733 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 24204
I20260807 15:20:13.337934 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:13.338274 16331 external_mini_cluster.cc:1428] Setting key 58a96b7e9ed3d283780a907d6773d49d
I20260807 15:20:13.341041 24300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc: Bootstrap starting.
I20260807 15:20:13.344092 24300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:13.345068 24300 log.cc:824] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:13.347795 24300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc: No bootstrap required, opened a new log
I20260807 15:20:13.350373 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:13.340053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39850 (local address 127.15.242.254:33297)
0807 15:20:13.341040 (+ 987us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:13.341065 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:13.341113 (+ 48us) server_negotiation.cc:407] Connection header received
0807 15:20:13.341984 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:13.342010 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:13.342584 (+ 574us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:13.342973 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:13.343460 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.345017 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.346359 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.347030 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.347217 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:13.348146 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:13.348152 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:13.348171 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:13.348690 (+ 519us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:13.348794 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:13.348825 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:13.348926 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:13.349097 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 15:20:13.349402 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":313,"threads_started":1}
I20260807 15:20:13.352578 24300 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279768e961d4f06a957ff5c1d87e5dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33297 } }
I20260807 15:20:13.352924 24300 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:13.353018 24300 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0279768e961d4f06a957ff5c1d87e5dc, State: Initialized, Role: FOLLOWER
I20260807 15:20:13.353528 24300 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279768e961d4f06a957ff5c1d87e5dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33297 } }
I20260807 15:20:13.353708 24300 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:13.353783 24300 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:13.353785 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:20:13.353888 24300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:13.355024 24300 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279768e961d4f06a957ff5c1d87e5dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33297 } }
I20260807 15:20:13.355396 24300 leader_election.cc:302] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0279768e961d4f06a957ff5c1d87e5dc; no voters:
I20260807 15:20:13.355794 24300 leader_election.cc:288] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:13.355957 24306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:13.356269 24306 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [term 1 LEADER]: Becoming Leader. State: Replica: 0279768e961d4f06a957ff5c1d87e5dc, State: Running, Role: LEADER
I20260807 15:20:13.356631 24306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279768e961d4f06a957ff5c1d87e5dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33297 } }
I20260807 15:20:13.357278 24300 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:13.358647 24309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0279768e961d4f06a957ff5c1d87e5dc. Latest consensus state: current_term: 1 leader_uuid: "0279768e961d4f06a957ff5c1d87e5dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279768e961d4f06a957ff5c1d87e5dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33297 } } }
I20260807 15:20:13.358807 24309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:13.358636 24307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0279768e961d4f06a957ff5c1d87e5dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0279768e961d4f06a957ff5c1d87e5dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33297 } } }
I20260807 15:20:13.358991 24307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:13.359230 24320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:13.362746 24320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:13.368981 24320 catalog_manager.cc:1347] Generated new cluster ID: e08ae817ea92428486bab80220996e44
I20260807 15:20:13.369077 24320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:13.386750 24320 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:13.387751 24320 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:13.392918 24320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0279768e961d4f06a957ff5c1d87e5dc: Generated new TSK 0
I20260807 15:20:13.393661 24320 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 15:20:13.434124 24343 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 15:20:13.434311 24343 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 15:20:13.434896 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:13.409049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39862 (local address 127.15.242.254:33297)
0807 15:20:13.409209 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:13.409215 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:13.409552 (+ 337us) server_negotiation.cc:407] Connection header received
0807 15:20:13.409825 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:13.409828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:13.409883 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:13.409976 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0807 15:20:13.410341 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.410983 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.412272 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.412526 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.412610 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:13.413061 (+ 451us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 15:20:13.434286 (+ 21225us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 15:20:13.434718 (+ 432us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39862: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":64}
W20260807 15:20:13.434998 24304 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39862: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 15:20:13.436143 24342 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:13.408956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:33297 (local address 127.0.0.1:39862)
0807 15:20:13.409381 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:13.409398 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:13.409565 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:13.410021 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:13.410025 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:13.410034 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 15:20:13.410190 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:13.410197 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.411103 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.411107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:13.412139 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:13.412150 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.412652 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.412657 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:13.412754 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:13.412843 (+ 89us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 15:20:13.434632 (+ 21789us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 15:20:13.434898 (+ 266us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.242.254:33297: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":170,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.15.242.254:33297: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43897/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 15:20:13.437150 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 24204
2026-08-07T15:20:13Z chronyd exiting
I20260807 15:20:13.486203 16331 test_util.cc:175] -----------------------------------------------
I20260807 15:20:13.486315 16331 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786115983990396-16331-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (350 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 15:20:13.487486 16331 mini_oidc.cc:152] Starting JWKS server
I20260807 15:20:13.488575 16331 webserver.cc:460] Webserver started at https://127.0.0.1:42431/ using document root <none> and password file <none>
I20260807 15:20:13.488730 16331 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 15:20:13.489136 16331 webserver.cc:460] Webserver started at http://127.0.0.1:44309/ using document root <none> and password file <none>
2026-08-07T15:20:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:13Z Disabled control of system clock
I20260807 15:20:13.500321 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:36897
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:35735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:36897
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42431/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/testchainca.cert with env {}
W20260807 15:20:13.615759 24349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:13.616011 24349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:13.616050 24349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:13.620088 24349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:13.620147 24349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:13.620163 24349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:13.620180 24349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:13.620195 24349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 15:20:13.620210 24349 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 15:20:13.620287 24349 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42431/jwks.json
I20260807 15:20:13.625516 24349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:36897
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:36897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42431/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:13.626593 24349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:13.627545 24349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:13.636655 24360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:13.636818 24349 server_base.cc:1034] running on GCE node
W20260807 15:20:13.636694 24357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:13.636754 24356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:13.637542 24349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:13.638628 24349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:13.639838 24349 hybrid_clock.cc:648] HybridClock initialized: now 1786116013639824 us; error 37 us; skew 500 ppm
I20260807 15:20:13.641822 24349 webserver.cc:460] Webserver started at http://127.15.242.254:45195/ using document root <none> and password file <none>
I20260807 15:20:13.642469 24349 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:13.642583 24349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:13.642827 24349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:13.645049 24349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "98453ccc222f4ee8b6122eb3c6418187"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "f48658ccdd26d30865f0a23f25836394"
server_key_iv: "d829054ea43f408ffb16586257ed3211"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.645692 24349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "98453ccc222f4ee8b6122eb3c6418187"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "f48658ccdd26d30865f0a23f25836394"
server_key_iv: "d829054ea43f408ffb16586257ed3211"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.649618 24349 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:20:13.652135 24374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:13.653535 24349 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:13.653687 24349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "98453ccc222f4ee8b6122eb3c6418187"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "f48658ccdd26d30865f0a23f25836394"
server_key_iv: "d829054ea43f408ffb16586257ed3211"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.653816 24349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:13.672986 24349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:13.673734 24349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:13.673947 24349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:13.681375 24349 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:36897
I20260807 15:20:13.681382 24446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:36897 every 8 connection(s)
I20260807 15:20:13.682360 24349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:13.685853 24447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:13.686951 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 24349
I20260807 15:20:13.687119 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:13.687438 16331 external_mini_cluster.cc:1428] Setting key deac72e6f70cf9224fda88150fa949be
I20260807 15:20:13.692196 24447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187: Bootstrap starting.
I20260807 15:20:13.694530 24447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:13.695290 24447 log.cc:824] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:13.697230 24451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:13.688945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54610 (local address 127.15.242.254:36897)
0807 15:20:13.689699 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:13.689722 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:13.689760 (+ 38us) server_negotiation.cc:407] Connection header received
0807 15:20:13.690413 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:13.690429 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:13.690817 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:13.691152 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:13.691598 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.692625 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.693613 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.694078 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.694280 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:13.695217 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:13.695223 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:13.695244 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:13.695710 (+ 466us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:13.695784 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:13.695811 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:13.695921 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:13.696135 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 15:20:13.696430 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":146,"threads_started":1}
I20260807 15:20:13.697577 24447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187: No bootstrap required, opened a new log
I20260807 15:20:13.700110 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:20:13.701954 24447 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98453ccc222f4ee8b6122eb3c6418187" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36897 } }
I20260807 15:20:13.702204 24447 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:13.702286 24447 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98453ccc222f4ee8b6122eb3c6418187, State: Initialized, Role: FOLLOWER
I20260807 15:20:13.702719 24447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98453ccc222f4ee8b6122eb3c6418187" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36897 } }
I20260807 15:20:13.702883 24447 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:13.702971 24447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:13.703094 24447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:13.703999 24447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98453ccc222f4ee8b6122eb3c6418187" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36897 } }
I20260807 15:20:13.704345 24447 leader_election.cc:302] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98453ccc222f4ee8b6122eb3c6418187; no voters:
I20260807 15:20:13.704677 24447 leader_election.cc:288] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:13.704900 24453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:13.705152 24453 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [term 1 LEADER]: Becoming Leader. State: Replica: 98453ccc222f4ee8b6122eb3c6418187, State: Running, Role: LEADER
I20260807 15:20:13.705475 24453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98453ccc222f4ee8b6122eb3c6418187" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36897 } }
I20260807 15:20:13.705986 24447 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:13.707491 24456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98453ccc222f4ee8b6122eb3c6418187. Latest consensus state: current_term: 1 leader_uuid: "98453ccc222f4ee8b6122eb3c6418187" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98453ccc222f4ee8b6122eb3c6418187" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36897 } } }
I20260807 15:20:13.707670 24456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:13.708180 24454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98453ccc222f4ee8b6122eb3c6418187" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98453ccc222f4ee8b6122eb3c6418187" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36897 } } }
I20260807 15:20:13.708309 24454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187 [sys.catalog]: This master's current role is: LEADER
W20260807 15:20:13.710947 24478 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:20:13.711015 24478 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:20:13.711114 24471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:13.711815 24471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:13.717519 24471 catalog_manager.cc:1347] Generated new cluster ID: e409005b64ba4ce3b299554156b26e50
I20260807 15:20:13.717592 24471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:13.736912 24471 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:13.737901 24471 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:13.743079 24471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98453ccc222f4ee8b6122eb3c6418187: Generated new TSK 0
I20260807 15:20:13.744017 24471 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 15:20:13.768296 24494 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 15:20:13.768393 24494 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 15:20:13.769268 24451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:13.752402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54616 (local address 127.15.242.254:36897)
0807 15:20:13.752546 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:13.752551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:13.752718 (+ 167us) server_negotiation.cc:407] Connection header received
0807 15:20:13.752950 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:13.752954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:13.753014 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:13.753136 (+ 122us) server_negotiation.cc:226] Negotiated authn=JWT
0807 15:20:13.753386 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.754248 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.755219 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.755577 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.755696 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:13.756197 (+ 501us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 15:20:13.768734 (+ 12537us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42431/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 15:20:13.769107 (+ 373us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54616: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42431/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 15:20:13.769351 24451 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54616: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42431/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 15:20:13.769376 24491 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:13.752239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36897 (local address 127.0.0.1:54616)
0807 15:20:13.752620 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:13.752633 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:13.752732 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:13.753157 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:13.753160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:13.753168 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 15:20:13.753271 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:13.753276 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.754379 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.754382 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:13.755068 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:13.755078 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:13.755783 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:13.755787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:13.755858 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:13.755882 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 15:20:13.769007 (+ 13125us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42431/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 15:20:13.769197 (+ 190us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.242.254:36897: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42431/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":125,"threads_started":1}
I20260807 15:20:13.770085 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 24349
2026-08-07T15:20:13Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (332 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 15:20:13.819492 16331 mini_oidc.cc:152] Starting JWKS server
I20260807 15:20:13.820363 16331 webserver.cc:460] Webserver started at https://127.0.0.1:36237/ using document root <none> and password file <none>
I20260807 15:20:13.820446 16331 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 15:20:13.820649 16331 webserver.cc:460] Webserver started at http://127.0.0.1:43951/ using document root <none> and password file <none>
2026-08-07T15:20:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:13Z Disabled control of system clock
I20260807 15:20:13.831641 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:35665
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:46669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:35665
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36237/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 15:20:13.948735 24504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:13.949019 24504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:13.949059 24504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:13.953083 24504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:13.953143 24504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:13.953159 24504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:13.953176 24504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:13.953192 24504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 15:20:13.953208 24504 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 15:20:13.953222 24504 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36237/jwks.json
I20260807 15:20:13.958086 24504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:35665
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:35665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36237/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:13.959173 24504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:13.960511 24504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:13.969550 24510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:13.969550 24513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:13.969676 24504 server_base.cc:1034] running on GCE node
W20260807 15:20:13.969753 24509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:13.970433 24504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:13.971673 24504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:13.972877 24504 hybrid_clock.cc:648] HybridClock initialized: now 1786116013972833 us; error 48 us; skew 500 ppm
I20260807 15:20:13.974925 24504 webserver.cc:460] Webserver started at http://127.15.242.254:38021/ using document root <none> and password file <none>
I20260807 15:20:13.975559 24504 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:13.975663 24504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:13.975916 24504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:13.978176 24504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "f682b15f370e42bf99f07f6cfc70b232"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "ede4e3eda80837747f5ca1b8239f8040"
server_key_iv: "bcda7014b8dfc17f0973c7726a6a2e6c"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.978790 24504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "f682b15f370e42bf99f07f6cfc70b232"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "ede4e3eda80837747f5ca1b8239f8040"
server_key_iv: "bcda7014b8dfc17f0973c7726a6a2e6c"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.982728 24504 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:13.985375 24521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:13.986831 24504 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:13.986990 24504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "f682b15f370e42bf99f07f6cfc70b232"
format_stamp: "Formatted at 2026-08-07 15:20:13 on dist-test-slave-g170"
server_key: "ede4e3eda80837747f5ca1b8239f8040"
server_key_iv: "bcda7014b8dfc17f0973c7726a6a2e6c"
server_key_version: "encryptionkey@0"
I20260807 15:20:13.987120 24504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:14.009527 24504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:14.010354 24504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:14.010588 24504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:14.018224 24504 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:35665
I20260807 15:20:14.018235 24597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:35665 every 8 connection(s)
I20260807 15:20:14.019266 24504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:14.022852 24600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:14.028720 24600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232: Bootstrap starting.
I20260807 15:20:14.028936 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 24504
I20260807 15:20:14.029064 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:14.029417 16331 external_mini_cluster.cc:1428] Setting key c7cec9c782221d5e55768b9209b5aa6a
I20260807 15:20:14.032131 24600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:14.033015 24600 log.cc:824] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:14.035379 24600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232: No bootstrap required, opened a new log
I20260807 15:20:14.040381 24600 raft_consensus.cc:348] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f682b15f370e42bf99f07f6cfc70b232" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35665 } }
I20260807 15:20:14.040663 24600 raft_consensus.cc:374] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:14.040756 24600 raft_consensus.cc:729] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682b15f370e42bf99f07f6cfc70b232, State: Initialized, Role: FOLLOWER
I20260807 15:20:14.041000 24605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:14.031871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57734 (local address 127.15.242.254:35665)
0807 15:20:14.032633 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:14.032647 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:14.032683 (+ 36us) server_negotiation.cc:407] Connection header received
0807 15:20:14.033541 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:14.033566 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:14.034021 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:14.034324 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:14.034743 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.035789 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.037240 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.037776 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.037909 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:14.038914 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:14.038919 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:14.038933 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:14.039355 (+ 422us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:14.039413 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:14.039434 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:14.039529 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:14.039739 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 15:20:14.040070 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":173,"threads_started":1}
I20260807 15:20:14.041366 24600 consensus_queue.cc:260] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f682b15f370e42bf99f07f6cfc70b232" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35665 } }
I20260807 15:20:14.041543 24600 raft_consensus.cc:388] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:14.041644 24600 raft_consensus.cc:482] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:14.041754 24600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:14.042753 24600 raft_consensus.cc:504] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f682b15f370e42bf99f07f6cfc70b232" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35665 } }
I20260807 15:20:14.043180 24600 leader_election.cc:302] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f682b15f370e42bf99f07f6cfc70b232; no voters:
I20260807 15:20:14.043572 24600 leader_election.cc:288] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:14.043678 24608 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:14.043951 24608 raft_consensus.cc:686] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [term 1 LEADER]: Becoming Leader. State: Replica: f682b15f370e42bf99f07f6cfc70b232, State: Running, Role: LEADER
I20260807 15:20:14.044148 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:20:14.044334 24608 consensus_queue.cc:237] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f682b15f370e42bf99f07f6cfc70b232" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35665 } }
I20260807 15:20:14.045025 24600 sys_catalog.cc:564] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:14.046906 24609 sys_catalog.cc:455] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f682b15f370e42bf99f07f6cfc70b232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f682b15f370e42bf99f07f6cfc70b232" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35665 } } }
I20260807 15:20:14.047029 24609 sys_catalog.cc:458] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:14.047931 24610 sys_catalog.cc:455] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f682b15f370e42bf99f07f6cfc70b232. Latest consensus state: current_term: 1 leader_uuid: "f682b15f370e42bf99f07f6cfc70b232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f682b15f370e42bf99f07f6cfc70b232" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35665 } } }
I20260807 15:20:14.048082 24610 sys_catalog.cc:458] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232 [sys.catalog]: This master's current role is: LEADER
W20260807 15:20:14.050271 24631 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:20:14.050395 24631 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:20:14.050477 24627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:14.051177 24627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:14.056893 24627 catalog_manager.cc:1347] Generated new cluster ID: 6d3b7e68f84342deb0b54a8ea0002124
I20260807 15:20:14.056955 24627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:14.064666 24627 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:14.065824 24627 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:14.074615 24627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f682b15f370e42bf99f07f6cfc70b232: Generated new TSK 0
I20260807 15:20:14.075379 24627 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:20:14.093696 24605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:14.088498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57742 (local address 127.15.242.254:35665)
0807 15:20:14.088638 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:14.088643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:14.088849 (+ 206us) server_negotiation.cc:407] Connection header received
0807 15:20:14.089014 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:14.089017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:14.089070 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:14.089174 (+ 104us) server_negotiation.cc:226] Negotiated authn=JWT
0807 15:20:14.089437 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.089989 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.091316 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.091535 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.091621 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:14.091958 (+ 337us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 15:20:14.093317 (+ 1359us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 15:20:14.093584 (+ 267us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57742: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 15:20:14.093789 24605 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57742: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 15:20:14.096668 24640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:14.088346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:35665 (local address 127.0.0.1:57742)
0807 15:20:14.088705 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:14.088720 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:14.088874 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:14.089200 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:14.089204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:14.089212 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 15:20:14.089325 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:14.089332 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.090115 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.090119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:14.091111 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:14.091141 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.091672 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.091676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:14.091764 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:14.091797 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 15:20:14.093484 (+ 1687us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 15:20:14.096485 (+ 3001us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.242.254:35665: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":2767,"thread_start_us":120,"threads_started":1}
I20260807 15:20:14.097136 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 24504
E20260807 15:20:14.115490 24642 webserver.cc:533] Webserver: sslize failed:
E20260807 15:20:14.115592 24642 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T15:20:14Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (328 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T15:20:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:14Z Disabled control of system clock
I20260807 15:20:14.160085 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:33845
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:33845
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/testchainca.cert with env {}
W20260807 15:20:14.278191 24647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:14.278529 24647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:14.278616 24647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:14.282757 24647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:14.282851 24647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:14.282881 24647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:14.282917 24647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:14.282951 24647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 15:20:14.282985 24647 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 15:20:14.283017 24647 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 15:20:14.288532 24647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:33845
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:33845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:14.289690 24647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:14.290726 24647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:14.300038 24666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:14.300086 24657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:14.300150 24661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:14.300411 24647 server_base.cc:1034] running on GCE node
I20260807 15:20:14.301051 24647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:14.302215 24647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:14.303397 24647 hybrid_clock.cc:648] HybridClock initialized: now 1786116014303377 us; error 31 us; skew 500 ppm
I20260807 15:20:14.305394 24647 webserver.cc:460] Webserver started at http://127.15.242.254:34127/ using document root <none> and password file <none>
I20260807 15:20:14.306015 24647 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:14.306118 24647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:14.306388 24647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:14.308454 24647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "852c7dac2aed4abb9ec41e155ac11358"
format_stamp: "Formatted at 2026-08-07 15:20:14 on dist-test-slave-g170"
server_key: "fde836166475112c42d5644c5e4e532b"
server_key_iv: "fe47b818ae714de7fbb8859b28565e38"
server_key_version: "encryptionkey@0"
I20260807 15:20:14.309055 24647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "852c7dac2aed4abb9ec41e155ac11358"
format_stamp: "Formatted at 2026-08-07 15:20:14 on dist-test-slave-g170"
server_key: "fde836166475112c42d5644c5e4e532b"
server_key_iv: "fe47b818ae714de7fbb8859b28565e38"
server_key_version: "encryptionkey@0"
I20260807 15:20:14.312901 24647 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:20:14.315454 24674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:14.316877 24647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:14.317025 24647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "852c7dac2aed4abb9ec41e155ac11358"
format_stamp: "Formatted at 2026-08-07 15:20:14 on dist-test-slave-g170"
server_key: "fde836166475112c42d5644c5e4e532b"
server_key_iv: "fe47b818ae714de7fbb8859b28565e38"
server_key_version: "encryptionkey@0"
I20260807 15:20:14.317152 24647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:14.373499 24647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:14.374332 24647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:14.374571 24647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:14.382351 24647 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:33845
I20260807 15:20:14.382360 24760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:33845 every 8 connection(s)
I20260807 15:20:14.383394 24647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:14.386566 24761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:14.387326 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 24647
I20260807 15:20:14.387470 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:14.387822 16331 external_mini_cluster.cc:1428] Setting key d7c21c3c4e5f3b0668ff4e6674647901
I20260807 15:20:14.393188 24761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358: Bootstrap starting.
I20260807 15:20:14.395551 24761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:14.396413 24761 log.cc:824] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:14.398172 24765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:14.389412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.15.242.254:33845)
0807 15:20:14.390118 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:14.390142 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:14.390179 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:20:14.390905 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:14.390925 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:14.391363 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:14.391762 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:14.392213 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.393336 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.394285 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.394797 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.394993 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:14.396050 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:14.396055 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:14.396070 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:14.396469 (+ 399us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:14.396588 (+ 119us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:14.396667 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:14.396754 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:14.397010 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 15:20:14.397323 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":141,"threads_started":1}
I20260807 15:20:14.398881 24761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358: No bootstrap required, opened a new log
I20260807 15:20:14.401644 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:20:14.403643 24761 raft_consensus.cc:348] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852c7dac2aed4abb9ec41e155ac11358" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33845 } }
I20260807 15:20:14.403891 24761 raft_consensus.cc:374] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:14.403930 24761 raft_consensus.cc:729] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 852c7dac2aed4abb9ec41e155ac11358, State: Initialized, Role: FOLLOWER
I20260807 15:20:14.404371 24761 consensus_queue.cc:260] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852c7dac2aed4abb9ec41e155ac11358" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33845 } }
I20260807 15:20:14.404500 24761 raft_consensus.cc:388] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:14.404542 24761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:14.404618 24761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:14.405622 24761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852c7dac2aed4abb9ec41e155ac11358" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33845 } }
I20260807 15:20:14.405936 24761 leader_election.cc:302] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 852c7dac2aed4abb9ec41e155ac11358; no voters:
I20260807 15:20:14.406208 24761 leader_election.cc:288] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:14.406451 24767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:14.406802 24767 raft_consensus.cc:686] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [term 1 LEADER]: Becoming Leader. State: Replica: 852c7dac2aed4abb9ec41e155ac11358, State: Running, Role: LEADER
I20260807 15:20:14.407166 24767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852c7dac2aed4abb9ec41e155ac11358" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33845 } }
I20260807 15:20:14.407541 24761 sys_catalog.cc:564] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:14.408921 24768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "852c7dac2aed4abb9ec41e155ac11358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852c7dac2aed4abb9ec41e155ac11358" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33845 } } }
I20260807 15:20:14.409090 24768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:14.409461 24769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 852c7dac2aed4abb9ec41e155ac11358. Latest consensus state: current_term: 1 leader_uuid: "852c7dac2aed4abb9ec41e155ac11358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "852c7dac2aed4abb9ec41e155ac11358" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33845 } } }
I20260807 15:20:14.409580 24769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:14.409536 24781 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:14.412879 24781 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:14.418651 24781 catalog_manager.cc:1347] Generated new cluster ID: 6fa3cc2c15834a269df97cbb2d6e5f05
I20260807 15:20:14.418727 24781 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:14.433341 24781 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:14.434576 24781 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:14.445245 24781 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 852c7dac2aed4abb9ec41e155ac11358: Generated new TSK 0
I20260807 15:20:14.446022 24781 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:20:15.338681 24765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:14.463159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50072 (local address 127.15.242.254:33845)
0807 15:20:14.463314 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:14.463321 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:14.463493 (+ 172us) server_negotiation.cc:407] Connection header received
0807 15:20:14.463659 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:14.463662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:14.463711 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:14.463804 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0807 15:20:14.464079 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.464637 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.465903 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.466133 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.466223 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:14.466616 (+ 393us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 15:20:15.338182 (+871566us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 15:20:15.338523 (+ 341us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50072: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":65}
W20260807 15:20:15.338851 24765 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50072: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 15:20:15.338850 24800 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:14.463069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:33845 (local address 127.0.0.1:50072)
0807 15:20:14.463391 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:14.463406 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:14.463532 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:14.463843 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:14.463846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:14.463856 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0807 15:20:14.463970 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:14.463976 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.464791 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.464795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:14.465760 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:14.465771 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:14.466313 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:14.466318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:14.466413 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:14.466442 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 15:20:15.338474 (+872032us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 15:20:15.338682 (+ 208us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.242.254:33845: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":123,"threads_started":1}
I20260807 15:20:15.340013 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 24647
2026-08-07T15:20:15Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1227 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (136 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (132 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:15 dist-test-slave-g170 krb5kdc[24823](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:15 dist-test-slave-g170 krb5kdc[24823](info): set up 2 sockets
Aug 07 15:20:15 dist-test-slave-g170 krb5kdc[24823](info): commencing operation
krb5kdc: starting...
W20260807 15:20:16.936978 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:17 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:17.083997 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:41817
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:41817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:17.199431 24843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:17.199699 24843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:17.199740 24843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:17.203734 24843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:17.203794 24843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:17.203814 24843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:17.203831 24843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:17.203846 24843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:17.209203 24843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:41817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:41817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:17.210295 24843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:17.211397 24843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:17.220253 24858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:17.220350 24853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:17.220317 24855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:17.220472 24843 server_base.cc:1034] running on GCE node
I20260807 15:20:17.221195 24843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:17.222353 24843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:17.223578 24843 hybrid_clock.cc:648] HybridClock initialized: now 1786116017223517 us; error 74 us; skew 500 ppm
Aug 07 15:20:17 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:17.226640 24843 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:17.227780 24843 webserver.cc:460] Webserver started at http://127.15.242.254:32969/ using document root <none> and password file <none>
I20260807 15:20:17.228394 24843 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:17.228499 24843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:17.228814 24843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:17.230967 24843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "388b80dc46ef4f96a1617f95dd26d00d"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "69d7b073285008cd62e226788308c6b4"
server_key_iv: "a9033061f0324b9ace2b52b30b3e51a5"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.231561 24843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "388b80dc46ef4f96a1617f95dd26d00d"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "69d7b073285008cd62e226788308c6b4"
server_key_iv: "a9033061f0324b9ace2b52b30b3e51a5"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.235556 24843 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 15:20:17.238484 24873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:17.239910 24843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:20:17.240082 24843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "388b80dc46ef4f96a1617f95dd26d00d"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "69d7b073285008cd62e226788308c6b4"
server_key_iv: "a9033061f0324b9ace2b52b30b3e51a5"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.240217 24843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:17.253609 24843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:17.257107 24843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:17.257333 24843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:17.265218 24843 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:41817
I20260807 15:20:17.265273 24944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:41817 every 8 connection(s)
I20260807 15:20:17.266299 24843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:17.269629 24946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:17.271842 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 24843
I20260807 15:20:17.272018 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:17.272339 16331 external_mini_cluster.cc:1428] Setting key 43fd9a59027a22e748c80c52a922ec9e
I20260807 15:20:17.276503 24946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d: Bootstrap starting.
I20260807 15:20:17.279548 24946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:17.280555 24946 log.cc:824] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d: Log is configured to *not* fsync() on all Append() calls
Aug 07 15:20:17 dist-test-slave-g170 krb5kdc[24823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:17.282791 24946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d: No bootstrap required, opened a new log
I20260807 15:20:17.287042 24946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b80dc46ef4f96a1617f95dd26d00d" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41817 } }
I20260807 15:20:17.287365 24946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:17.287479 24946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388b80dc46ef4f96a1617f95dd26d00d, State: Initialized, Role: FOLLOWER
I20260807 15:20:17.287994 24946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b80dc46ef4f96a1617f95dd26d00d" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41817 } }
I20260807 15:20:17.288131 24946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:17.288231 24946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:17.288370 24946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:17.288517 24949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:17.274089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33040 (local address 127.15.242.254:41817)
0807 15:20:17.274562 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:17.274579 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:17.274622 (+ 43us) server_negotiation.cc:407] Connection header received
0807 15:20:17.275272 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:17.275295 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:17.275652 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:17.275931 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:17.277049 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.278108 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.279431 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.279988 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.280122 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:17.283015 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:17.283020 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:17.283035 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:17.283063 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:17.284961 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:17.285437 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:17.285442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:17.285447 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:17.285560 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:17.286064 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:17.286067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:17.286069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:17.286508 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:17.286742 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:17.287099 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 15:20:17.287472 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":148,"threads_started":1}
I20260807 15:20:17.289494 24946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b80dc46ef4f96a1617f95dd26d00d" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41817 } }
I20260807 15:20:17.289935 24946 leader_election.cc:302] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 388b80dc46ef4f96a1617f95dd26d00d; no voters:
I20260807 15:20:17.290307 24946 leader_election.cc:288] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:17.290467 24953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:17.290818 24953 raft_consensus.cc:686] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [term 1 LEADER]: Becoming Leader. State: Replica: 388b80dc46ef4f96a1617f95dd26d00d, State: Running, Role: LEADER
I20260807 15:20:17.291163 24953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b80dc46ef4f96a1617f95dd26d00d" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41817 } }
I20260807 15:20:17.291720 24946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:17.293184 24958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "388b80dc46ef4f96a1617f95dd26d00d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b80dc46ef4f96a1617f95dd26d00d" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41817 } } }
I20260807 15:20:17.293336 24958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:17.293637 24954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 388b80dc46ef4f96a1617f95dd26d00d. Latest consensus state: current_term: 1 leader_uuid: "388b80dc46ef4f96a1617f95dd26d00d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b80dc46ef4f96a1617f95dd26d00d" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 41817 } } }
I20260807 15:20:17.293756 24954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:17.293866 24969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:17.297042 24969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:17.303776 24969 catalog_manager.cc:1347] Generated new cluster ID: a5d7071a8c984b58bf304fd6b9b6bfdf
I20260807 15:20:17.303853 24969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:17.321880 24969 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:17.322914 24969 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:17.337323 24969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 388b80dc46ef4f96a1617f95dd26d00d: Generated new TSK 0
I20260807 15:20:17.338214 24969 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:20:17.377002 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41817
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:17.496866 24984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:17.497141 24984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:17.497186 24984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:17.501224 24984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:17.501276 24984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:17.501380 24984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:17.506675 24984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:17.508016 24984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:17.509063 24984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:17.519074 24995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:17.519120 24993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:17.519307 24984 server_base.cc:1034] running on GCE node
W20260807 15:20:17.519063 24998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:17.519884 24984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:17.520610 24984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:17.521862 24984 hybrid_clock.cc:648] HybridClock initialized: now 1786116017521847 us; error 28 us; skew 500 ppm
Aug 07 15:20:17 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:17.525154 24984 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:20:17.526041 24984 webserver.cc:460] Webserver started at http://127.15.242.193:35095/ using document root <none> and password file <none>
I20260807 15:20:17.526641 24984 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:17.526744 24984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:17.527035 24984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:17.529217 24984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "5e874d20c1ab4049850744f7b72ff902"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "1518b998466812a9ee4a9d7df07b8c02"
server_key_iv: "44a03fecf0ed408ab1a5ee14f4a6cff9"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.529819 24984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "5e874d20c1ab4049850744f7b72ff902"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "1518b998466812a9ee4a9d7df07b8c02"
server_key_iv: "44a03fecf0ed408ab1a5ee14f4a6cff9"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.533869 24984 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:20:17.536580 25008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:17.538267 24984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:20:17.538439 24984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "5e874d20c1ab4049850744f7b72ff902"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "1518b998466812a9ee4a9d7df07b8c02"
server_key_iv: "44a03fecf0ed408ab1a5ee14f4a6cff9"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.538583 24984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:17.557260 24984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:17.560328 24984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:17.560555 24984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:17.561221 24984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:17.562106 24984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:17.562196 24984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:17.562273 24984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:17.562317 24984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:17.572281 24984 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:34825
I20260807 15:20:17.572317 25169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:34825 every 8 connection(s)
I20260807 15:20:17.573244 24984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:17.574932 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 24984
I20260807 15:20:17.575035 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:17.575451 16331 external_mini_cluster.cc:1428] Setting key 3f3293b26c423883c460b757da51a628
Aug 07 15:20:17 dist-test-slave-g170 krb5kdc[24823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:20:17.589838 24949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:17.575320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:33651 (local address 127.15.242.254:41817)
0807 15:20:17.575516 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:17.575522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:17.576549 (+ 1027us) server_negotiation.cc:407] Connection header received
0807 15:20:17.578236 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:17.578242 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:17.578306 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:17.578427 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:17.579791 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.580647 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.582007 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.582470 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.582608 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:17.585568 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:17.585571 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:17.585573 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:17.585599 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:17.587277 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:17.587977 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:17.587980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:17.587981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:17.588065 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:17.588407 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:17.588409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:17.588410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:17.588591 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:17.588670 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:17.589430 (+ 760us) server_negotiation.cc:299] Negotiation successful
0807 15:20:17.589588 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 15:20:17.590919 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:17.575789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:41817 (local address 127.15.242.193:33651)
0807 15:20:17.576373 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:17.576431 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:17.577995 (+ 1564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:17.578605 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:17.578612 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:17.579065 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:17.579629 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:17.579644 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.580889 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.580892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:17.581861 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:17.581871 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.582635 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.582638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:17.582842 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:17.583541 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:17.583559 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:17.585363 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:17.587400 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:17.587406 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:17.587447 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:17.587854 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:17.588159 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:17.588162 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:17.588163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:17.588305 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:17.588708 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:17.588749 (+ 41us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:17.589064 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 15:20:17.589319 (+ 255us) client_negotiation.cc:240] Negotiation successful
0807 15:20:17.589673 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":155,"threads_started":1}
I20260807 15:20:17.592623 25170 heartbeater.cc:347] Connected to a master server at 127.15.242.254:41817
I20260807 15:20:17.593043 25170 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:17.593588 25170 heartbeater.cc:511] Master 127.15.242.254:41817 requested a full tablet report, sending...
I20260807 15:20:17.595542 24893 ts_manager.cc:194] Registered new tserver with Master: 5e874d20c1ab4049850744f7b72ff902 (127.15.242.193:34825)
I20260807 15:20:17.597277 24893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:33651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:20:17.608394 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41817
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:17.725157 25180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:17.725457 25180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:17.725535 25180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:17.729662 25180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:17.729749 25180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:17.729842 25180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:17.735183 25180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:17.736363 25180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:17.737620 25180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:17.748466 25191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:17.748479 25187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:17.748510 25188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:17.748744 25180 server_base.cc:1034] running on GCE node
I20260807 15:20:17.749383 25180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:17.750072 25180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:17.751272 25180 hybrid_clock.cc:648] HybridClock initialized: now 1786116017751240 us; error 49 us; skew 500 ppm
Aug 07 15:20:17 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:17.754519 25180 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:20:17.755607 25180 webserver.cc:460] Webserver started at http://127.15.242.194:37575/ using document root <none> and password file <none>
I20260807 15:20:17.756289 25180 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:17.756374 25180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:17.756641 25180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:17.759094 25180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "688a495460ce459b9dd3cf3d2d3cbb74"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "ec8437e37a297690c564be0867e86660"
server_key_iv: "ffff7ad4de2e504234b9f2ac38f6cbf0"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.759784 25180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "688a495460ce459b9dd3cf3d2d3cbb74"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "ec8437e37a297690c564be0867e86660"
server_key_iv: "ffff7ad4de2e504234b9f2ac38f6cbf0"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.764134 25180 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:20:17.767374 25204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:17.769239 25180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:17.769407 25180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "688a495460ce459b9dd3cf3d2d3cbb74"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "ec8437e37a297690c564be0867e86660"
server_key_iv: "ffff7ad4de2e504234b9f2ac38f6cbf0"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.769550 25180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:17.783829 25180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:17.787297 25180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:17.787555 25180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:17.788269 25180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:17.789271 25180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:17.789354 25180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:17.789423 25180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:17.789481 25180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:17.800287 25180 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:44349
I20260807 15:20:17.800575 25376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:44349 every 8 connection(s)
I20260807 15:20:17.801419 25180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:17.806074 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 25180
I20260807 15:20:17.806226 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:17.806556 16331 external_mini_cluster.cc:1428] Setting key c6ae1dc950035cbaef4e94224dc24c4a
Aug 07 15:20:17 dist-test-slave-g170 krb5kdc[24823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:20:17.818809 24949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:17.803491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:43111 (local address 127.15.242.254:41817)
0807 15:20:17.803640 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:17.803644 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:17.804523 (+ 879us) server_negotiation.cc:407] Connection header received
0807 15:20:17.806305 (+ 1782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:17.806310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:17.806379 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:17.806459 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:17.808047 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.808636 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.810705 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.811090 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.811229 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:17.814394 (+ 3165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:17.814397 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:17.814399 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:17.814426 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:17.815979 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:17.816567 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:17.816571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:17.816573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:17.816662 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:17.817280 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:17.817283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:17.817284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:17.817498 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:17.817760 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:17.818488 (+ 728us) server_negotiation.cc:299] Negotiation successful
0807 15:20:17.818630 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 15:20:17.819844 25380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:17.803839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:41817 (local address 127.15.242.194:43111)
0807 15:20:17.804341 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:17.804389 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:17.805982 (+ 1593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:17.806695 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:17.806705 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:17.807227 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:17.807806 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:17.807821 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.808936 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.808943 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:17.810525 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:17.810542 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:17.811292 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:17.811295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:17.811457 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:17.812203 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:17.812222 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:17.814185 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:17.816129 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:17.816135 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:17.816154 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:17.816443 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:17.816794 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:17.816800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:17.816802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:17.816960 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:17.817773 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:17.817788 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:17.818159 (+ 371us) client_negotiation.cc:769] Sending connection context
0807 15:20:17.818418 (+ 259us) client_negotiation.cc:240] Negotiation successful
0807 15:20:17.818830 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:20:17.821496 25377 heartbeater.cc:347] Connected to a master server at 127.15.242.254:41817
I20260807 15:20:17.821820 25377 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:17.822389 25377 heartbeater.cc:511] Master 127.15.242.254:41817 requested a full tablet report, sending...
I20260807 15:20:17.823572 24893 ts_manager.cc:194] Registered new tserver with Master: 688a495460ce459b9dd3cf3d2d3cbb74 (127.15.242.194:44349)
I20260807 15:20:17.824273 24893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:43111
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:20:17.841444 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41817
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:17.963009 25386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:17.963284 25386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:17.963326 25386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:17.967506 25386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:17.967614 25386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:17.967692 25386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:17.973086 25386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:41817
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:17.974632 25386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:17.975689 25386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:17.985617 25398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:17.985639 25395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:17.985800 25386 server_base.cc:1034] running on GCE node
W20260807 15:20:17.985980 25396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:17.986392 25386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:17.987111 25386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:17.988343 25386 hybrid_clock.cc:648] HybridClock initialized: now 1786116017988308 us; error 46 us; skew 500 ppm
Aug 07 15:20:17 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:17.991398 25386 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:20:17.992376 25386 webserver.cc:460] Webserver started at http://127.15.242.195:41221/ using document root <none> and password file <none>
I20260807 15:20:17.993105 25386 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:17.993216 25386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:17.993467 25386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:17.995643 25386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "3b8535057d6b40569c14260c9a5affae"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "285e519f36e6c4d5a8f6944958b201bc"
server_key_iv: "60b92bb3c97b59570c04e252dd39fc7a"
server_key_version: "encryptionkey@0"
I20260807 15:20:17.996251 25386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "3b8535057d6b40569c14260c9a5affae"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "285e519f36e6c4d5a8f6944958b201bc"
server_key_iv: "60b92bb3c97b59570c04e252dd39fc7a"
server_key_version: "encryptionkey@0"
I20260807 15:20:18.000418 25386 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260807 15:20:18.003135 25406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:18.004447 25386 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:18.004604 25386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "3b8535057d6b40569c14260c9a5affae"
format_stamp: "Formatted at 2026-08-07 15:20:17 on dist-test-slave-g170"
server_key: "285e519f36e6c4d5a8f6944958b201bc"
server_key_iv: "60b92bb3c97b59570c04e252dd39fc7a"
server_key_version: "encryptionkey@0"
I20260807 15:20:18.004732 25386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:18.016639 25386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:18.019891 25386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:18.020370 25386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:18.021152 25386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:18.022045 25386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:18.022094 25386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:18.022176 25386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:18.022212 25386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:18.031461 25386 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:41359
I20260807 15:20:18.031534 25587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:41359 every 8 connection(s)
I20260807 15:20:18.032421 25386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:18.040793 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 25386
I20260807 15:20:18.040939 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:18.041292 16331 external_mini_cluster.cc:1428] Setting key 02747bb51ccceeff82dcbe6372982b96
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116017, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:18.047847 24949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:18.034458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:55347 (local address 127.15.242.254:41817)
0807 15:20:18.034652 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:18.034658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:18.035474 (+ 816us) server_negotiation.cc:407] Connection header received
0807 15:20:18.036884 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:18.036887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:18.036936 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:18.037015 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:18.038221 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.038853 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.040145 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.040374 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.040468 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:18.043225 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:18.043229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:18.043231 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:18.043260 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:18.045251 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:18.046053 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:18.046056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:18.046058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:18.046163 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:18.046590 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:18.046594 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:18.046596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:18.046798 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:18.046920 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:18.047614 (+ 694us) server_negotiation.cc:299] Negotiation successful
0807 15:20:18.047729 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 15:20:18.048720 25590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:18.034828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:41817 (local address 127.15.242.195:55347)
0807 15:20:18.035312 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:18.035356 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:18.036612 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:18.037189 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:18.037196 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:18.037575 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:18.038048 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:18.038061 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.038993 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.038996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:18.039992 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:18.040003 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.040556 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.040560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:18.040801 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:18.041464 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:18.041485 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:18.043065 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:18.045410 (+ 2345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:18.045418 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:18.045435 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:18.045919 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:18.046296 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:18.046302 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:18.046305 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:18.046476 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:18.046920 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:18.046928 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:18.047295 (+ 367us) client_negotiation.cc:769] Sending connection context
0807 15:20:18.047527 (+ 232us) client_negotiation.cc:240] Negotiation successful
0807 15:20:18.047798 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":131,"threads_started":1}
I20260807 15:20:18.049921 25588 heartbeater.cc:347] Connected to a master server at 127.15.242.254:41817
I20260807 15:20:18.050179 25588 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:18.050668 25588 heartbeater.cc:511] Master 127.15.242.254:41817 requested a full tablet report, sending...
I20260807 15:20:18.051843 24893 ts_manager.cc:194] Registered new tserver with Master: 3b8535057d6b40569c14260c9a5affae (127.15.242.195:41359)
I20260807 15:20:18.052520 24893 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:55347
I20260807 15:20:18.055323 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/test-admin.keytab.
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:18.073949 16331 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 15:20:18.077013 25602 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:18.075449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54032 (local address 127.15.242.193:34825)
0807 15:20:18.075827 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:18.075842 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:18.075867 (+ 25us) server_negotiation.cc:407] Connection header received
0807 15:20:18.075921 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:18.075926 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:18.076116 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:18.076254 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:18.076770 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54032: BlockingRecv error: recv got EOF from 127.0.0.1:54032 (error 108)
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":146,"threads_started":1}
W20260807 15:20:18.077409 16331 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5cc)
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:18.078428 16331 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:18.079368 16331 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:20:18.089905 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:18.080230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54040 (local address 127.15.242.193:34825)
0807 15:20:18.080420 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:18.080423 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:18.080437 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:18.080555 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:18.080557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:18.080595 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:18.080662 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:18.081258 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.082043 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.082880 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.083267 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.083355 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:18.085951 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:18.085961 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:18.085975 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:18.085999 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:18.087765 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:18.088211 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:18.088216 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:18.088217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:18.088300 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:18.088607 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:18.088609 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:18.088610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:18.088955 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:18.089295 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:18.089503 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 15:20:18.089771 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 15:20:18.094301 25602 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:18.093252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54046 (local address 127.15.242.193:34825)
0807 15:20:18.093369 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:18.093372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:18.093477 (+ 105us) server_negotiation.cc:407] Connection header received
0807 15:20:18.093575 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:18.093577 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:18.093612 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:18.093682 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:18.094170 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54046: BlockingRecv error: recv got EOF from 127.0.0.1:54046 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 15:20:18.094539 16331 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5cc' of type FILE
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:18.095564 16331 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:18.096483 16331 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:20:18.106215 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:18.097455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54060 (local address 127.15.242.193:34825)
0807 15:20:18.097576 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:18.097580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:18.097749 (+ 169us) server_negotiation.cc:407] Connection header received
0807 15:20:18.097902 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:18.097905 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:18.097949 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:18.098035 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:18.098633 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.099191 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.099997 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.100232 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.100345 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:18.102945 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:18.102950 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:18.102952 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:18.102983 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:18.104379 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:18.104925 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:18.104929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:18.104931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:18.105029 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:18.105338 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:18.105341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:18.105343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:18.105519 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:18.105666 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:18.105921 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 15:20:18.106044 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 15:20:18.109476 25602 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:18.108318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54072 (local address 127.15.242.193:34825)
0807 15:20:18.108493 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:18.108497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:18.108511 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:18.108720 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:18.108724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:18.108834 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:18.108920 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:18.109350 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54072: BlockingRecv error: recv got EOF from 127.0.0.1:54072 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 15:20:18.109516 16331 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786115983990396-16331-0/krb5kdc/krb5cc' of type FILE
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:18.110643 16331 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:18.111660 16331 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[24823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:20:18.120926 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:18.112545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54084 (local address 127.15.242.193:34825)
0807 15:20:18.112643 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:18.112646 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:18.112697 (+ 51us) server_negotiation.cc:407] Connection header received
0807 15:20:18.112856 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:18.112858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:18.112894 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:18.112962 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:18.113449 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.113974 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.114741 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:18.114969 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:18.115055 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:18.117710 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:18.117714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:18.117715 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:18.117737 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:18.119210 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:18.119701 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:18.119705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:18.119707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:18.119790 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:18.120094 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:18.120097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:18.120099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:18.120268 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:18.120411 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:18.120653 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 15:20:18.120753 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 15:20:18.122058 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 24984
I20260807 15:20:18.137693 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 25180
I20260807 15:20:18.153739 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 25386
I20260807 15:20:18.168265 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 24843
2026-08-07T15:20:18Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2554 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[25621](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[25621](info): set up 2 sockets
Aug 07 15:20:18 dist-test-slave-g170 krb5kdc[25621](info): commencing operation
krb5kdc: starting...
W20260807 15:20:19.677155 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.477s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:19 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:19Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.254.keytab.
Entry for principal oryx/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.254.keytab.
I20260807 15:20:19.909760 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:44795
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.254.keytab
--principal=oryx/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:44795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:20.138216 25640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:20.138918 25640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:20.139084 25640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:20.145874 25640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:20.146014 25640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:20.146106 25640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:20.146219 25640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:20.146332 25640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:20.156194 25640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:44795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.254.keytab
--principal=oryx/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:44795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:20.158403 25640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:20.160409 25640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:20.178849 25649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:20.178846 25650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:20.179390 25640 server_base.cc:1034] running on GCE node
W20260807 15:20:20.178862 25653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:20.180588 25640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:20.182799 25640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:20.184299 25640 hybrid_clock.cc:648] HybridClock initialized: now 1786116020184275 us; error 62 us; skew 500 ppm
Aug 07 15:20:20 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116020, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:20.189900 25640 init.cc:377] Logged in from keytab as oryx/127.15.242.254@KRBTEST.COM (short username oryx)
I20260807 15:20:20.192016 25640 webserver.cc:460] Webserver started at http://127.15.242.254:41767/ using document root <none> and password file <none>
I20260807 15:20:20.193337 25640 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:20.193584 25640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:20.194046 25640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:20.198740 25640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "a35eaf2a50e44728b18c5e9e914ca8d1"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "3379993e41df884242156e0024b986c8"
server_key_iv: "114eff14f51e25e80120266d57252da9"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.199903 25640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "a35eaf2a50e44728b18c5e9e914ca8d1"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "3379993e41df884242156e0024b986c8"
server_key_iv: "114eff14f51e25e80120266d57252da9"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.208163 25640 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.010s sys 0.000s
I20260807 15:20:20.213479 25663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:20.216336 25640 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260807 15:20:20.216627 25640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "a35eaf2a50e44728b18c5e9e914ca8d1"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "3379993e41df884242156e0024b986c8"
server_key_iv: "114eff14f51e25e80120266d57252da9"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.216935 25640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:20.249969 25640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:20.255927 25640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:20.256278 25640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:20.271412 25640 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:44795
I20260807 15:20:20.271528 25735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:44795 every 8 connection(s)
I20260807 15:20:20.274119 25640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:20.276626 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 25640
I20260807 15:20:20.276926 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:20.277876 16331 external_mini_cluster.cc:1428] Setting key 1953b3146bf5a268683f442a0e93ace2
I20260807 15:20:20.286900 25736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 15:20:20 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:20.302907 25736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: Bootstrap starting.
I20260807 15:20:20.306672 25736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:20.307871 25736 log.cc:824] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:20.310863 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:20.283053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55442 (local address 127.15.242.254:44795)
0807 15:20:20.284155 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:20.284199 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:20.284284 (+ 85us) server_negotiation.cc:407] Connection header received
0807 15:20:20.286231 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:20.286309 (+ 78us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:20.287323 (+ 1014us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:20.288377 (+ 1054us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:20.290700 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:20.294811 (+ 4111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:20.297893 (+ 3082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:20.298831 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:20.299007 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:20.303462 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:20.303482 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:20.303543 (+ 61us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:20.303674 (+ 131us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:20.306140 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:20.306802 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:20.306809 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:20.306816 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:20.307030 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:20.307428 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:20.307432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:20.307434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:20.308102 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:20.308330 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:20.308809 (+ 479us) server_negotiation.cc:299] Negotiation successful
0807 15:20:20.309412 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":300,"threads_started":1}
I20260807 15:20:20.311136 25736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: No bootstrap required, opened a new log
I20260807 15:20:20.315853 25736 raft_consensus.cc:348] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } }
I20260807 15:20:20.316161 25736 raft_consensus.cc:374] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:20.316220 25736 raft_consensus.cc:729] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35eaf2a50e44728b18c5e9e914ca8d1, State: Initialized, Role: FOLLOWER
I20260807 15:20:20.316732 25736 consensus_queue.cc:260] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } }
I20260807 15:20:20.316974 25736 raft_consensus.cc:388] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:20.317054 25736 raft_consensus.cc:482] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:20.317195 25736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:20.318634 25736 raft_consensus.cc:504] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } }
I20260807 15:20:20.319083 25736 leader_election.cc:302] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a35eaf2a50e44728b18c5e9e914ca8d1; no voters:
I20260807 15:20:20.319087 25742 raft_consensus.cc:482] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:20.319497 25742 raft_consensus.cc:504] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } }
I20260807 15:20:20.319505 25736 leader_election.cc:288] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:20.320103 25745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:20.320170 25742 leader_election.cc:302] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a35eaf2a50e44728b18c5e9e914ca8d1; no voters:
I20260807 15:20:20.320325 25745 raft_consensus.cc:686] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 LEADER]: Becoming Leader. State: Replica: a35eaf2a50e44728b18c5e9e914ca8d1, State: Running, Role: LEADER
I20260807 15:20:20.320429 25742 leader_election.cc:288] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers
I20260807 15:20:20.320690 25745 consensus_queue.cc:237] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } }
I20260807 15:20:20.321465 25736 sys_catalog.cc:564] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:20.322551 25742 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a35eaf2a50e44728b18c5e9e914ca8d1. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } }
I20260807 15:20:20.322686 25742 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:20.323100 25761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:20.323530 25750 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } }
I20260807 15:20:20.323735 25750 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:20.327349 25761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:20.334630 25761 catalog_manager.cc:1347] Generated new cluster ID: 6be3e683a328480793754c8f5653ef8a
I20260807 15:20:20.334723 25761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:20.347723 25761 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:20.349099 25761 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:20.356998 25761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: Generated new TSK 0
I20260807 15:20:20.357683 25761 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab.
Entry for principal oryx/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab.
I20260807 15:20:20.421568 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44795
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab
--principal=oryx/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:20.642634 25775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:20.642940 25775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:20.642987 25775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:20.647212 25775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:20.647281 25775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:20.647342 25775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:20.652905 25775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab
--principal=oryx/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:20.654007 25775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:20.655035 25775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:20.664896 25782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:20.664952 25775 server_base.cc:1034] running on GCE node
W20260807 15:20:20.664906 25780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:20.664899 25785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:20.665557 25775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:20.666304 25775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:20.667512 25775 hybrid_clock.cc:648] HybridClock initialized: now 1786116020667487 us; error 34 us; skew 500 ppm
Aug 07 15:20:20 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116020, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:20.670531 25775 init.cc:377] Logged in from keytab as oryx/127.15.242.193@KRBTEST.COM (short username oryx)
I20260807 15:20:20.671473 25775 webserver.cc:460] Webserver started at http://127.15.242.193:38511/ using document root <none> and password file <none>
I20260807 15:20:20.672055 25775 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:20.672154 25775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:20.672396 25775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:20.674544 25775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "6d264750702440a4b29f210b803c7c90"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "2dff677d69d7b1b30370a51e6dc5736d"
server_key_iv: "d07235fe55b089be132e6ffe2cd931b5"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.675138 25775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "6d264750702440a4b29f210b803c7c90"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "2dff677d69d7b1b30370a51e6dc5736d"
server_key_iv: "d07235fe55b089be132e6ffe2cd931b5"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.679164 25775 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:20.682019 25801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:20.683363 25775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:20.683508 25775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "6d264750702440a4b29f210b803c7c90"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "2dff677d69d7b1b30370a51e6dc5736d"
server_key_iv: "d07235fe55b089be132e6ffe2cd931b5"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.683629 25775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:20.709934 25775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:20.713742 25775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:20.713980 25775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:20.714639 25775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:20.715548 25775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:20.715628 25775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:20.715723 25775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:20.715778 25775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:20.732558 25775 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:43793
I20260807 15:20:20.732604 25980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:43793 every 8 connection(s)
I20260807 15:20:20.734833 25775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:20.737468 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 25775
I20260807 15:20:20.737679 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:20.738106 16331 external_mini_cluster.cc:1428] Setting key 07d54d5743fd9b99295a8f3447ef5947
Aug 07 15:20:20 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116020, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.15.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.194@KRBTEST.COM" created.
I20260807 15:20:20.768041 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:20.738257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:53387 (local address 127.15.242.254:44795)
0807 15:20:20.738559 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:20.738564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:20.741290 (+ 2726us) server_negotiation.cc:407] Connection header received
0807 15:20:20.744253 (+ 2963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:20.744282 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:20.744638 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:20.745548 (+ 910us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:20.748276 (+ 2728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:20.749226 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:20.753770 (+ 4544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:20.754229 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:20.754394 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:20.762121 (+ 7727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:20.762125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:20.762127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:20.762158 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:20.764003 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:20.764787 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:20.764791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:20.764793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:20.764898 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:20.765326 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:20.765330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:20.765332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:20.765614 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:20.765742 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:20.766416 (+ 674us) server_negotiation.cc:299] Negotiation successful
0807 15:20:20.766900 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 15:20:20.769553 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:20.738992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:53387)
0807 15:20:20.740910 (+ 1918us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:20.741003 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:20.743348 (+ 2345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:20.746131 (+ 2783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:20.746142 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:20.747123 (+ 981us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:20.748058 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:20.748088 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:20.749672 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:20.749693 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:20.753230 (+ 3537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:20.753297 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:20.754812 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:20.754822 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:20.755676 (+ 854us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:20.757405 (+ 1729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:20.757435 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:20.761857 (+ 4422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:20.764199 (+ 2342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:20.764240 (+ 41us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:20.764301 (+ 61us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:20.764634 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:20.765015 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:20.765018 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:20.765020 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:20.765193 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:20.765750 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:20.765765 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:20.766074 (+ 309us) client_negotiation.cc:769] Sending connection context
0807 15:20:20.766352 (+ 278us) client_negotiation.cc:240] Negotiation successful
0807 15:20:20.767999 (+ 1647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1364,"thread_start_us":178,"threads_started":1}
I20260807 15:20:20.771708 25981 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44795
I20260807 15:20:20.772435 25981 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:20.774556 25981 heartbeater.cc:511] Master 127.15.242.254:44795 requested a full tablet report, sending...
I20260807 15:20:20.779445 25690 ts_manager.cc:194] Registered new tserver with Master: 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793)
I20260807 15:20:20.782186 25690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:53387
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab.
Entry for principal oryx/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab.
I20260807 15:20:20.796346 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44795
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab
--principal=oryx/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:20.929440 25991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:20.929720 25991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:20.929768 25991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:20.934237 25991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:20.934301 25991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:20.934366 25991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:20.940244 25991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab
--principal=oryx/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:20.941404 25991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:20.942485 25991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:20.953718 26000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:20.953742 26003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:20.953771 26001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:20.954169 25991 server_base.cc:1034] running on GCE node
I20260807 15:20:20.954646 25991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:20.955364 25991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:20.956583 25991 hybrid_clock.cc:648] HybridClock initialized: now 1786116020956548 us; error 44 us; skew 500 ppm
Aug 07 15:20:20 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116020, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:20.959951 25991 init.cc:377] Logged in from keytab as oryx/127.15.242.194@KRBTEST.COM (short username oryx)
I20260807 15:20:20.961012 25991 webserver.cc:460] Webserver started at http://127.15.242.194:35137/ using document root <none> and password file <none>
I20260807 15:20:20.961645 25991 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:20.961760 25991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:20.962041 25991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:20.964358 25991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "1820be41aaf54e17b2636f9133f451a8"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "254c99e393c8f3d365c94e494ad8cdca"
server_key_iv: "71879defb50508dbc5cd89981f62cb52"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.965124 25991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "1820be41aaf54e17b2636f9133f451a8"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "254c99e393c8f3d365c94e494ad8cdca"
server_key_iv: "71879defb50508dbc5cd89981f62cb52"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.969640 25991 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:20:20.972591 26015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:20.974100 25991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:20.974300 25991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "1820be41aaf54e17b2636f9133f451a8"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "254c99e393c8f3d365c94e494ad8cdca"
server_key_iv: "71879defb50508dbc5cd89981f62cb52"
server_key_version: "encryptionkey@0"
I20260807 15:20:20.974439 25991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:20.990757 25991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:20.994464 25991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:20.994726 25991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:20.995455 25991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:20.996490 25991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:20.996583 25991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:20.996670 25991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:20.996742 25991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.007676 25991 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:38723
I20260807 15:20:21.007761 26186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:38723 every 8 connection(s)
I20260807 15:20:21.008868 25991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:21.015704 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 25991
I20260807 15:20:21.015873 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:21.016172 16331 external_mini_cluster.cc:1428] Setting key 0f66b3c9b9e2d9f94fe3646360f2e7e0
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116020, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:21.027134 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.011186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:39159 (local address 127.15.242.254:44795)
0807 15:20:21.011366 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.011372 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.012435 (+ 1063us) server_negotiation.cc:407] Connection header received
0807 15:20:21.014047 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.014050 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.014107 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.014195 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.015640 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.016411 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.018405 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.018678 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.018776 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.022237 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.022244 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.022251 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.022288 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.024435 (+ 2147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.025078 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.025093 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.025097 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.025208 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.025653 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.025666 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.025672 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.026015 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.026174 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.026750 (+ 576us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.026919 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 15:20:21.027947 26190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.011690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:39159)
0807 15:20:21.012252 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.012302 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.013804 (+ 1502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.014382 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.014389 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.014793 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.015339 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.015354 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.016565 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.016570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.018238 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.018251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.018864 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.018872 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.019127 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.019896 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.019927 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.021965 (+ 2038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.024564 (+ 2599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.024570 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.024584 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.024951 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.025315 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.025318 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.025319 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.025469 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.026206 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.026212 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.026462 (+ 250us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.026628 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.026966 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":127,"threads_started":1}
I20260807 15:20:21.029320 26187 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44795
I20260807 15:20:21.029644 26187 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:20:21.030349 26187 heartbeater.cc:511] Master 127.15.242.254:44795 requested a full tablet report, sending...
I20260807 15:20:21.031574 25690 ts_manager.cc:194] Registered new tserver with Master: 1820be41aaf54e17b2636f9133f451a8 (127.15.242.194:38723)
I20260807 15:20:21.032286 25690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:39159
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab.
Entry for principal oryx/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab.
I20260807 15:20:21.051783 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44795
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab
--principal=oryx/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:21.183766 26193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:21.184052 26193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:21.184132 26193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:21.188675 26193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:21.188751 26193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:21.188867 26193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:21.194765 26193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab
--principal=oryx/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:21.195897 26193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:21.197063 26193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:21.207417 26199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:21.207454 26202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:21.207461 26200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:21.207814 26193 server_base.cc:1034] running on GCE node
I20260807 15:20:21.208179 26193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:21.208926 26193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:21.210143 26193 hybrid_clock.cc:648] HybridClock initialized: now 1786116021210121 us; error 31 us; skew 500 ppm
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:21.213065 26193 init.cc:377] Logged in from keytab as oryx/127.15.242.195@KRBTEST.COM (short username oryx)
I20260807 15:20:21.213894 26193 webserver.cc:460] Webserver started at http://127.15.242.195:35693/ using document root <none> and password file <none>
I20260807 15:20:21.214417 26193 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:21.214476 26193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:21.214710 26193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:21.216717 26193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "15fbb376d0074f4ba98944cf7fa3f5b4"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "c9693ec1d1e9e5603178e48e4cc26440"
server_key_iv: "b186b017b507c2ca435da968dab3e8ee"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.217360 26193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "15fbb376d0074f4ba98944cf7fa3f5b4"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "c9693ec1d1e9e5603178e48e4cc26440"
server_key_iv: "b186b017b507c2ca435da968dab3e8ee"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.221172 26193 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:20:21.223884 26216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.225397 26193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:21.225515 26193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "15fbb376d0074f4ba98944cf7fa3f5b4"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "c9693ec1d1e9e5603178e48e4cc26440"
server_key_iv: "b186b017b507c2ca435da968dab3e8ee"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.225612 26193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:21.239419 26193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:21.242975 26193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:21.243142 26193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:21.243731 26193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:21.244612 26193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:21.244673 26193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.244717 26193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:21.244735 26193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.254701 26391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:39175 every 8 connection(s)
I20260807 15:20:21.254769 26193 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:39175
I20260807 15:20:21.255764 26193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:21.259727 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 26193
I20260807 15:20:21.259871 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:21.260183 16331 external_mini_cluster.cc:1428] Setting key e34314ebfbc3cf4a1b52cea466e84e6a
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:21.271309 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.257770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:59271 (local address 127.15.242.254:44795)
0807 15:20:21.257940 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.257946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.258873 (+ 927us) server_negotiation.cc:407] Connection header received
0807 15:20:21.260558 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.260561 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.260611 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.260688 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.262577 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.263176 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.264468 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.264728 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.264883 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.267438 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.267442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.267445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.267477 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.269109 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.269624 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.269629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.269631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.269721 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.270064 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.270069 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.270070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.270253 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.270359 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.270943 (+ 584us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.271130 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 15:20:21.272214 26398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.258146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.195:59271)
0807 15:20:21.258696 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.258745 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.260290 (+ 1545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.260985 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.260997 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.261623 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.262355 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.262378 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.263309 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.263312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.264332 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.264343 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.264924 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.264929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.265138 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.265735 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.265752 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.267264 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.269231 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.269237 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.269252 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.269516 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.269814 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.269818 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.269820 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.269964 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.270358 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.270366 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.270654 (+ 288us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.270880 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.271232 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":129,"threads_started":1}
I20260807 15:20:21.273527 26394 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44795
I20260807 15:20:21.273836 26394 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:21.274459 26394 heartbeater.cc:511] Master 127.15.242.254:44795 requested a full tablet report, sending...
I20260807 15:20:21.275530 25690 ts_manager.cc:194] Registered new tserver with Master: 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175)
I20260807 15:20:21.276155 25690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:59271
I20260807 15:20:21.286162 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.242.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.253.keytab.
Entry for principal oryx/127.15.242.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.253.keytab.
I20260807 15:20:21.316001 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.253:40251
--webserver_interface=127.15.242.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.253.keytab
--principal=oryx/127.15.242.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:44795,127.15.242.253:40251
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:21.441551 26402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:21.441851 26402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:21.441952 26402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:21.446062 26402 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:21.446152 26402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:21.446194 26402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:21.446256 26402 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:21.446298 26402 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:21.451694 26402 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:44795,127.15.242.253:40251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.253.keytab
--principal=oryx/127.15.242.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.253:40251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.242.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
W20260807 15:20:21.451943 26402 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.15.242.254:44795,127.15.242.253:40251'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 15:20:21.452885 26402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:21.453944 26402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:21.462885 26411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:21.462986 26410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:21.462885 26414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:21.463177 26402 server_base.cc:1034] running on GCE node
I20260807 15:20:21.463763 26402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:21.465272 26402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:21.466482 26402 hybrid_clock.cc:648] HybridClock initialized: now 1786116021466451 us; error 48 us; skew 500 ppm
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:21.469507 26402 init.cc:377] Logged in from keytab as oryx/127.15.242.253@KRBTEST.COM (short username oryx)
I20260807 15:20:21.470474 26402 webserver.cc:460] Webserver started at http://127.15.242.253:35599/ using document root <none> and password file <none>
I20260807 15:20:21.471048 26402 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:21.471143 26402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:21.471391 26402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:21.473593 26402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data/instance:
uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "363f92e9f88966601d785369d6dfc0b8"
server_key_iv: "33ee67510b9ce8378197abcc5c0e60e7"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.474171 26402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal/instance:
uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "363f92e9f88966601d785369d6dfc0b8"
server_key_iv: "33ee67510b9ce8378197abcc5c0e60e7"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.478001 26402 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260807 15:20:21.480535 26425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.481866 26402 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:20:21.481972 26402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "363f92e9f88966601d785369d6dfc0b8"
server_key_iv: "33ee67510b9ce8378197abcc5c0e60e7"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.482057 26402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:21.495596 26402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:21.498440 26402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:21.498589 26402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:21.506073 26402 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.253:40251
I20260807 15:20:21.506389 26497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.253:40251 every 8 connection(s)
I20260807 15:20:21.507167 26402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
I20260807 15:20:21.510131 26499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:21.513988 26499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:20:21.516067 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 26402
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.253@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.242.253@KRBTEST.COM
I20260807 15:20:21.529793 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.515891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55446 (local address 127.15.242.254:44795)
0807 15:20:21.516090 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.516096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.517142 (+ 1046us) server_negotiation.cc:407] Connection header received
0807 15:20:21.518402 (+ 1260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.518409 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.518475 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.518566 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.519507 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.520344 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.521654 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.521997 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.522106 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.525304 (+ 3198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.525313 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.525315 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.525341 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.527048 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.527625 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.527630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.527635 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.527792 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.528131 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.528137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.528139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.528526 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.528633 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.529485 (+ 852us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.529618 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 15:20:21.530655 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.516355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:55446)
0807 15:20:21.516997 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.517039 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.518101 (+ 1062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.518762 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.518767 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.519113 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.519378 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.519392 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.520503 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.520506 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.521473 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.521484 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.522166 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.522170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.522319 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.522999 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.523017 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.525120 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.527177 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.527186 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.527198 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.527506 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.527894 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.527897 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.527899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.528026 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.528661 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.528668 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.529112 (+ 444us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.529320 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.529655 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":168,"threads_started":1}
I20260807 15:20:21.530659 26503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.517452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37012 (local address 127.15.242.253:40251)
0807 15:20:21.517894 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.517905 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.517947 (+ 42us) server_negotiation.cc:407] Connection header received
0807 15:20:21.518100 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.518120 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.518397 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.518605 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.519445 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.520663 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.521546 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.522226 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.522336 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.525735 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.525742 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.525756 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.525785 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.527302 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.527794 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.527798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.527800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.527961 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.528357 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.528363 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.528367 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.529073 (+ 706us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.529336 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.529760 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.529914 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"spinlock_wait_cycles":3840,"thread_start_us":119,"threads_started":1}
I20260807 15:20:21.532265 26499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.253@KRBTEST.COM for oryx/127.15.242.253@KRBTEST.COM
I20260807 15:20:21.540155 26501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.532840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.0.0.1:37016)
0807 15:20:21.532952 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.532965 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.533062 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.533418 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.533421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.533554 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.533654 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.533659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.534416 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.534418 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.534954 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.534962 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.535410 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.535413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.535493 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.535903 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.535915 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.537226 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.538947 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.538949 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.538950 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.539129 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.539409 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.539411 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.539412 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.539485 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.539804 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.539806 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.539877 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.539958 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.540049 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 15:20:21.540282 26503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.533122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37016 (local address 127.15.242.253:40251)
0807 15:20:21.533238 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.533241 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.533249 (+ 8us) server_negotiation.cc:407] Connection header received
0807 15:20:21.533272 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.533274 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.533302 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.533358 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.533781 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.534297 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.535072 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.535308 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.535392 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.537352 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.537355 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.537357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.537378 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.538845 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.539250 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.539253 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.539254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.539326 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.539563 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.539565 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.539566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.539721 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.539796 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.540015 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.540108 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:20:21.543720 26499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Bootstrap starting.
I20260807 15:20:21.546794 26499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:21.547706 26499 log.cc:824] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:21.549739 26499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: No bootstrap required, opened a new log
I20260807 15:20:21.553164 26499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } }
I20260807 15:20:21.553371 26499 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:21.553408 26499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ed8a733e7b4a3e9fbff646a5eb25ab, State: Initialized, Role: FOLLOWER
I20260807 15:20:21.553814 26499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } }
I20260807 15:20:21.554252 26505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } } }
I20260807 15:20:21.554397 26505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:20:21.555022 26499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: configured and running, proceeding with master startup.
W20260807 15:20:21.559916 26523 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:20:21.560005 26523 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:20:21.562265 26402 master_runner.cc:428] Detected that this master 89ed8a733e7b4a3e9fbff646a5eb25ab is joining an existing cluster
I20260807 15:20:21.562322 26402 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.242.253:40251
I20260807 15:20:21.574043 26503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.565315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37030 (local address 127.15.242.253:40251)
0807 15:20:21.565419 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.565424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.565710 (+ 286us) server_negotiation.cc:407] Connection header received
0807 15:20:21.565817 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.565820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.565868 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.565967 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.566534 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.567329 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.568490 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.568876 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.569001 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.570374 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.570378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.570380 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.570405 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.572329 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.572904 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.572910 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.572915 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.573001 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.573304 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.573308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.573310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.573512 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.573603 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.573849 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.573938 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 15:20:21.574070 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.564620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55452 (local address 127.15.242.254:44795)
0807 15:20:21.564808 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.564814 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.564984 (+ 170us) server_negotiation.cc:407] Connection header received
0807 15:20:21.565121 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.565128 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.565193 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.565281 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.566078 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.566790 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.567914 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.568166 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.568293 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.570235 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.570239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.570243 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.570271 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.572225 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.572733 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.572737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.572739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.572875 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.573166 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.573169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.573171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.573396 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.573504 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.573796 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.573916 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 15:20:21.574057 26536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.564554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:55452)
0807 15:20:21.564882 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.564897 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.565005 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.565438 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.565441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.565738 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.565920 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.565936 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.566939 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.566943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.567775 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.567784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.568307 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.568311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.568418 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.569617 (+ 1199us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.569636 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.570072 (+ 436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.572359 (+ 2287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.572365 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.572369 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.572625 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.572980 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.572983 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.572985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.573082 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.573493 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.573496 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.573593 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.573699 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.573849 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":104,"threads_started":1}
I20260807 15:20:21.574501 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.565255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.0.0.1:37030)
0807 15:20:21.565601 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.565614 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.565721 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.566013 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.566017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.566227 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.566392 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.566400 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.567455 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.567459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.568359 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.568371 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.569067 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.569073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.569190 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.569754 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.569768 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.570234 (+ 466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.572438 (+ 2204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.572442 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.572444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.572797 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.573097 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.573102 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.573104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.573200 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.573605 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.573608 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.573691 (+ 83us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.574244 (+ 553us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.574389 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":10,"thread_start_us":87,"threads_started":1}
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116020, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.254@KRBTEST.COM for oryx/127.15.242.253@KRBTEST.COM
I20260807 15:20:21.589810 26543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.578974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.0.0.1:37042)
0807 15:20:21.579729 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.579781 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.579914 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.580205 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.580211 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.580633 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.580795 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.580803 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.581479 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.581482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.582469 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.582480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.582911 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.582915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.583047 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.583748 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.583763 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.585508 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.587750 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.587760 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.587767 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.588029 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.588444 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.588449 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.588451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.588552 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.589126 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.589133 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.589268 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.589428 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.589621 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":67,"threads_started":1}
I20260807 15:20:21.590226 26503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.579019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37042 (local address 127.15.242.253:40251)
0807 15:20:21.579119 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.579122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.579865 (+ 743us) server_negotiation.cc:407] Connection header received
0807 15:20:21.580039 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.580041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.580082 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.580145 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.580905 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.581373 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.582593 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.582791 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.582870 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.585647 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.585651 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.585654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.585677 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.587610 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.588147 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.588154 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.588168 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.588323 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.588663 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.588670 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.588675 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.588987 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.589105 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.589516 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.589659 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 15:20:21.591845 25690 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.242.253:40251: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab"
member_type: NON_VOTER
last_known_addr {
host: "127.15.242.253"
port: 40251
}
attrs {
promote: true
}
}
dest_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1"
cas_config_opid_index: -1
I20260807 15:20:21.592893 25690 consensus_queue.cc:237] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } }
I20260807 15:20:21.595309 26547 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 89ed8a733e7b4a3e9fbff646a5eb25ab (127.15.242.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } }
I20260807 15:20:21.596210 26466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:21.597158 26547 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.242.253:40251
I20260807 15:20:21.597605 26402 master.cc:537] Master@127.15.242.253:40251 shutting down...
I20260807 15:20:21.597685 26466 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Refusing update from remote peer a35eaf2a50e44728b18c5e9e914ca8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 15:20:21.597757 26546 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } }
I20260807 15:20:21.598148 26546 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:21.598453 26546 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
WARNING: no policy specified for oryx/127.15.242.252@KRBTEST.COM; defaulting to no policy
W20260807 15:20:21.601439 25667 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.252@KRBTEST.COM" created.
I20260807 15:20:21.602646 26402 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:21.602927 26402 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:21.603032 26402 tablet_replica.cc:330] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: stopping tablet replica
W20260807 15:20:21.604856 25667 consensus_peers.cc:487] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 -> Peer 89ed8a733e7b4a3e9fbff646a5eb25ab (127.15.242.253:40251): Couldn't send request to peer 89ed8a733e7b4a3e9fbff646a5eb25ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:20:21.608124 26402 master.cc:552] Master@127.15.242.253:40251 shutdown complete.
I20260807 15:20:21.608184 26402 master_runner.cc:305] Clearing existing system tablet
I20260807 15:20:21.608474 26402 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:21.608541 26402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:21.610170 26402 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:21.611207 26555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.611430 26402 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:21.611544 26402 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:21.611577 26402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "363f92e9f88966601d785369d6dfc0b8"
server_key_iv: "33ee67510b9ce8378197abcc5c0e60e7"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.613729 26402 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:21.616919 26402 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 15:20:21.617030 26402 log.cc:1196] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 15:20:21.617271 26402 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Deleting consensus metadata
I20260807 15:20:21.618036 26402 master_runner.cc:315] Copying system tablet from 127.15.242.254:44795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.252.keytab.
Entry for principal oryx/127.15.242.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.252.keytab.
I20260807 15:20:21.619442 26402 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.254:44795
I20260807 15:20:21.619989 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.252:39519
--webserver_interface=127.15.242.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.252.keytab
--principal=oryx/127.15.242.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:44795,127.15.242.253:40251,127.15.242.252:39519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:20:21.629109 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.620089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55454 (local address 127.15.242.254:44795)
0807 15:20:21.620233 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.620240 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.620470 (+ 230us) server_negotiation.cc:407] Connection header received
0807 15:20:21.620701 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.620704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.620754 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.620956 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.621410 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.622474 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.624155 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.624455 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.624567 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.625885 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.625889 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.625891 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.625917 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.627420 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.627870 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.627873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.627875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.627956 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.628240 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.628244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.628246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.628423 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.628531 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.628854 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.628961 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:20:21.629123 26563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.620011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:55454)
0807 15:20:21.620384 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.620397 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.620565 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.620973 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.620977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.621181 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.621285 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.621291 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.622675 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.622689 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.624032 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.624043 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.624570 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.624574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.624674 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.625369 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.625380 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.625699 (+ 319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.627534 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.627539 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.627542 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.627754 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.628057 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.628060 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.628062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.628149 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.628522 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.628525 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.628626 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.628735 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.628908 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":95,"threads_started":1}
I20260807 15:20:21.630131 25712 tablet_copy_service.cc:140] P a35eaf2a50e44728b18c5e9e914ca8d1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 89ed8a733e7b4a3e9fbff646a5eb25ab ({username='oryx', principal='oryx/127.15.242.253@KRBTEST.COM'} at 127.0.0.1:55454)
I20260807 15:20:21.630324 25712 tablet_copy_service.cc:161] P a35eaf2a50e44728b18c5e9e914ca8d1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 89ed8a733e7b4a3e9fbff646a5eb25ab at {username='oryx', principal='oryx/127.15.242.253@KRBTEST.COM'} at 127.0.0.1:55454: session id = 89ed8a733e7b4a3e9fbff646a5eb25ab-00000000000000000000000000000000
I20260807 15:20:21.631950 25712 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:20:21.633626 26402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 15:20:21.635509 26402 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: tablet copy: Starting download of 0 data blocks...
I20260807 15:20:21.635723 26402 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: tablet copy: Starting download of 1 WAL segments...
I20260807 15:20:21.637391 26402 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:20:21.638862 25712 tablet_copy_service.cc:342] P a35eaf2a50e44728b18c5e9e914ca8d1: Request end of tablet copy session 89ed8a733e7b4a3e9fbff646a5eb25ab-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.242.253@KRBTEST.COM'} at 127.0.0.1:55454
I20260807 15:20:21.638978 25712 tablet_copy_service.cc:433] P a35eaf2a50e44728b18c5e9e914ca8d1: ending tablet copy session 89ed8a733e7b4a3e9fbff646a5eb25ab-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 89ed8a733e7b4a3e9fbff646a5eb25ab
I20260807 15:20:21.645534 26402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:21.647280 26565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:21.647425 26569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:21.647655 26402 server_base.cc:1034] running on GCE node
W20260807 15:20:21.647877 26566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:21.649295 26402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:21.649646 26402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:21.650802 26402 hybrid_clock.cc:648] HybridClock initialized: now 1786116021650816 us; error 48 us; skew 500 ppm
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:21.652315 26402 init.cc:377] Logged in from keytab as oryx/127.15.242.253@KRBTEST.COM (short username oryx)
I20260807 15:20:21.652837 26402 webserver.cc:460] Webserver started at http://127.15.242.253:40767/ using document root <none> and password file <none>
I20260807 15:20:21.653044 26402 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:21.653110 26402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:21.654186 26402 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:21.655115 26580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.655359 26402 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:21.655457 26402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "363f92e9f88966601d785369d6dfc0b8"
server_key_iv: "33ee67510b9ce8378197abcc5c0e60e7"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.655553 26402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:21.669059 26402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:21.671052 26402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:21.676178 26402 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.253:40251
I20260807 15:20:21.676841 26402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
I20260807 15:20:21.677058 26652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.253:40251 every 8 connection(s)
I20260807 15:20:21.679626 26653 sys_catalog.cc:263] Verifying existing consensus state
I20260807 15:20:21.680430 26653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Bootstrap starting.
I20260807 15:20:21.689083 26653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:20:21.689375 26653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Bootstrap complete.
I20260807 15:20:21.689867 26653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } }
I20260807 15:20:21.690003 26653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 89ed8a733e7b4a3e9fbff646a5eb25ab, State: Initialized, Role: LEARNER
I20260807 15:20:21.690120 26653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } }
I20260807 15:20:21.690455 26658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } }
I20260807 15:20:21.690616 26658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: This master's current role is: LEARNER
I20260807 15:20:21.690632 26653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:21.693580 26675 catalog_manager.cc:1259] Loaded cluster ID: 6be3e683a328480793754c8f5653ef8a
I20260807 15:20:21.693691 26675 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: loading cluster ID for follower catalog manager: success
I20260807 15:20:21.695304 26675 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: acquiring CA information for follower catalog manager: success
I20260807 15:20:21.696382 26675 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 15:20:21.778872 26564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:21.779181 26564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:21.779273 26564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:21.783397 26564 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:21.783491 26564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:21.783531 26564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:21.783569 26564 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:21.783610 26564 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:21.787333 25981 heartbeater.cc:503] Master 127.15.242.254:44795 was elected leader, sending a full tablet report...
I20260807 15:20:21.789630 26564 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:44795,127.15.242.253:40251,127.15.242.252:39519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.252.keytab
--principal=oryx/127.15.242.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.252:39519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.242.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:21.790941 26564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:21.792269 26564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:21.801671 26685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:21.801625 26683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:21.801625 26688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:21.801918 26564 server_base.cc:1034] running on GCE node
I20260807 15:20:21.802671 26564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:21.803869 26564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:21.805065 26564 hybrid_clock.cc:648] HybridClock initialized: now 1786116021805049 us; error 30 us; skew 500 ppm
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:21.808270 26564 init.cc:377] Logged in from keytab as oryx/127.15.242.252@KRBTEST.COM (short username oryx)
I20260807 15:20:21.809459 26564 webserver.cc:460] Webserver started at http://127.15.242.252:38171/ using document root <none> and password file <none>
I20260807 15:20:21.810076 26564 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:21.810142 26564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:21.810331 26564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:21.812582 26564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data/instance:
uuid: "d4f83163231b4693b63a4e9b2f738de9"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "345a1edb98e513f012acbdddb879cebd"
server_key_iv: "1eeee1bd164239a3c3c77862d63a7a3e"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.813256 26564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal/instance:
uuid: "d4f83163231b4693b63a4e9b2f738de9"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "345a1edb98e513f012acbdddb879cebd"
server_key_iv: "1eeee1bd164239a3c3c77862d63a7a3e"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.817498 26564 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:20:21.820495 26700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.822096 26564 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:21.822259 26564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
uuid: "d4f83163231b4693b63a4e9b2f738de9"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "345a1edb98e513f012acbdddb879cebd"
server_key_iv: "1eeee1bd164239a3c3c77862d63a7a3e"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.822371 26564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:21.839999 26564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:21.843878 26564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:21.844074 26564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:21.852707 26564 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.252:39519
I20260807 15:20:21.853068 26788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.252:39519 every 8 connection(s)
I20260807 15:20:21.853953 26564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
I20260807 15:20:21.857197 26789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:21.859648 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 26564
I20260807 15:20:21.861783 26789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.252@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.242.252@KRBTEST.COM
I20260807 15:20:21.875064 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.863685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55456 (local address 127.15.242.254:44795)
0807 15:20:21.863840 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.863845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.864360 (+ 515us) server_negotiation.cc:407] Connection header received
0807 15:20:21.864489 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.864492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.864538 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.864719 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.865536 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.866289 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.867295 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.867519 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.867646 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.870538 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.870543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.870549 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.870581 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.872504 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.873267 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.873270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.873271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.873355 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.873830 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.873838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.873840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.874049 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.874190 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.874747 (+ 557us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.874875 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 15:20:21.875990 26792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.863542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:55456)
0807 15:20:21.864136 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.864235 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.864384 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.864839 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.864851 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.865204 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.865377 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.865387 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.866419 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.866425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.867163 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.867172 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.867699 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.867703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.867890 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.868503 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.868519 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.870381 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.872636 (+ 2255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.872646 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.872657 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.873156 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.873477 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.873481 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.873483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.873704 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.874194 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.874204 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.874472 (+ 268us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.874686 (+ 214us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.875016 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":61,"spinlock_wait_cycles":768,"thread_start_us":160,"threads_started":1}
I20260807 15:20:21.875988 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.861288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40886 (local address 127.15.242.252:39519)
0807 15:20:21.861839 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.861883 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.861923 (+ 40us) server_negotiation.cc:407] Connection header received
0807 15:20:21.862807 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.862836 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.863285 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.863672 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.864782 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.866064 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.867165 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.867569 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.867830 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.871113 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.871119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.871129 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.871150 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.873239 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.873727 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.873733 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.873735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.873826 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.874194 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.874198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.874200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.874480 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.874762 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.874939 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.875093 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":387,"thread_start_us":151,"threads_started":1}
I20260807 15:20:21.877458 26789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.252@KRBTEST.COM for oryx/127.15.242.253@KRBTEST.COM
I20260807 15:20:21.886469 26792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.878033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.0.0.1:37052)
0807 15:20:21.878476 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.878489 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.878564 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.879083 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.879086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.879232 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.879323 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.879328 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.880266 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.880268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.880868 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.880884 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.881365 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.881367 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.881442 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.881850 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.881861 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.883081 (+ 1220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.885100 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.885102 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.885104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.885307 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.885561 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.885563 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.885565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.885639 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.886076 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.886078 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.886156 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.886260 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.886360 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365}
I20260807 15:20:21.886657 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.878209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37052 (local address 127.15.242.253:40251)
0807 15:20:21.878540 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.878544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.878558 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:21.878729 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.878733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.878793 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.878879 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.879466 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.880150 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.880989 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.881261 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.881357 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.883229 (+ 1872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.883232 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.883234 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.883258 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.884981 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.885398 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.885400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.885401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.885477 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.885764 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.885767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.885769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.885971 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.886072 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.886330 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.886440 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":115,"threads_started":1}
I20260807 15:20:21.887434 26789 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116021, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.252@KRBTEST.COM for oryx/127.15.242.252@KRBTEST.COM
I20260807 15:20:21.895530 26792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.887945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39519 (local address 127.0.0.1:40888)
0807 15:20:21.888121 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.888134 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.888200 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.888393 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.888395 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.888518 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.888583 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.888587 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.889326 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.889329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.889833 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.889841 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.890278 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.890281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.890338 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.890818 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.890830 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.892136 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.893826 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.893829 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.893830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.894041 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.894407 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.894409 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.894410 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.894562 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.895013 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.895015 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.895101 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.895197 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.895354 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260807 15:20:21.895553 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.888124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40888 (local address 127.15.242.252:39519)
0807 15:20:21.888219 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.888223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.888235 (+ 12us) server_negotiation.cc:407] Connection header received
0807 15:20:21.888264 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.888266 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.888297 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.888367 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.888681 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.889224 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.889933 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.890173 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.890251 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.892256 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.892259 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.892261 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.892281 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.893718 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.894193 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.894198 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.894199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.894311 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.894673 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.894676 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.894678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.894926 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.895021 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.895243 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.895428 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":91,"server-negotiator.queue_time_us":27}
I20260807 15:20:21.899044 26789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Bootstrap starting.
I20260807 15:20:21.901471 26789 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:21.902221 26789 log.cc:824] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:21.904242 26789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: No bootstrap required, opened a new log
I20260807 15:20:21.907334 26789 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } }
I20260807 15:20:21.907526 26789 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:21.907589 26789 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f83163231b4693b63a4e9b2f738de9, State: Initialized, Role: FOLLOWER
I20260807 15:20:21.908016 26789 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } }
I20260807 15:20:21.908536 26796 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } } }
I20260807 15:20:21.908672 26796 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:20:21.909301 26789 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 15:20:21.914289 26810 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:20:21.914381 26810 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:20:21.918154 26564 master_runner.cc:428] Detected that this master d4f83163231b4693b63a4e9b2f738de9 is joining an existing cluster
I20260807 15:20:21.918221 26564 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.242.252:39519
I20260807 15:20:21.929766 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 25775
I20260807 15:20:21.930161 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.920845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55458 (local address 127.15.242.254:44795)
0807 15:20:21.920996 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.921002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.921245 (+ 243us) server_negotiation.cc:407] Connection header received
0807 15:20:21.921438 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.921442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.921498 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.921550 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.922326 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.923195 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.924525 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.924905 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.924986 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.926539 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.926544 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.926546 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.926573 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.928229 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.928784 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.928788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.928790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.928876 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.929187 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.929191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.929193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.929406 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.929475 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.929847 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.929963 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 15:20:21.930652 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.920723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:55458)
0807 15:20:21.921159 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.921175 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.921321 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.921724 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.921727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.921988 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.922155 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.922164 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.923396 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.923400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.924379 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.924390 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.925168 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.925172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.925263 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.925864 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.925881 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.926378 (+ 497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.928359 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.928363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.928365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.928641 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.928990 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.928993 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.928995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.929080 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.929557 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.929559 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.929658 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.930321 (+ 663us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.930465 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":133,"threads_started":1}
I20260807 15:20:21.932953 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.921275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37064 (local address 127.15.242.253:40251)
0807 15:20:21.921413 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.921417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.922171 (+ 754us) server_negotiation.cc:407] Connection header received
0807 15:20:21.922437 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.922441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.922496 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.922564 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.923228 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.924121 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.926008 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.926415 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.926518 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.928400 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.928404 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.928406 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.928431 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.931023 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.931546 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.931550 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.931552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.931660 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.931995 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.931998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.932000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.932202 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.932271 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.932636 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.932802 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:20:21.933400 26820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.921207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.0.0.1:37064)
0807 15:20:21.922050 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.922065 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.922248 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.922785 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.922788 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.922985 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.923086 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.923092 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.924321 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.924324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.925823 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.925834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.926804 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.926808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.927085 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.927816 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.927829 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.928219 (+ 390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.931153 (+ 2934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.931157 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.931159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.931419 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.931776 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.931779 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.931781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.931878 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.932347 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.932349 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.932447 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.933077 (+ 630us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.933225 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"mutex_wait_us":45,"thread_start_us":138,"threads_started":1}
I20260807 15:20:21.950045 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.921700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39519 (local address 127.0.0.1:40892)
0807 15:20:21.923357 (+ 1657us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.923372 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.923563 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.923866 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.923869 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.924071 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.924210 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.924220 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.925436 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.925439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.926364 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.926375 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.927039 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.927043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.927214 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.945572 (+ 18358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.945586 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.945982 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.948298 (+ 2316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.948301 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.948304 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.948581 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.948940 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.948943 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.948946 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.949039 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.949461 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.949463 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.949543 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.949668 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.949824 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1579,"thread_start_us":94,"threads_started":1}
I20260807 15:20:21.950294 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:43793
--local_ip_for_outbound_sockets=127.15.242.193
--tserver_master_addrs=127.15.242.254:44795
--webserver_port=38511
--webserver_interface=127.15.242.193
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab
--principal=oryx/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251,127.15.242.252:39519 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:20:21.951685 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.921785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40892 (local address 127.15.242.252:39519)
0807 15:20:21.922744 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.922749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.923458 (+ 709us) server_negotiation.cc:407] Connection header received
0807 15:20:21.923662 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.923665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.923700 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.923746 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.924331 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.925305 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.926497 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.926817 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.926897 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.946142 (+ 19245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.946148 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.946153 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.946182 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.948174 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.948704 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.948708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.948710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.948835 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.949131 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.949134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.949136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.949341 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.949428 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.950446 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.950581 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":869}
Aug 07 15:20:21 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116020, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.254@KRBTEST.COM for oryx/127.15.242.252@KRBTEST.COM
I20260807 15:20:21.956707 26821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.945291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40898 (local address 127.15.242.252:39519)
0807 15:20:21.946277 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.946288 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.946304 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:20:21.946389 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.946395 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.946475 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.947245 (+ 770us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.947404 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.948347 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.949697 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.950054 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.950726 (+ 672us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.952861 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:21.952866 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:21.952868 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:21.952894 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:21.954603 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.955194 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.955198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.955200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.955295 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:21.955652 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:21.955655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:21.955657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:21.955867 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:21.955966 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.956333 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.956458 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":908,"thread_start_us":134,"threads_started":1}
I20260807 15:20:21.956794 26543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.944957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39519 (local address 127.0.0.1:40898)
0807 15:20:21.945277 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.945294 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.945386 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.946654 (+ 1268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.946659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.946901 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.947071 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.947082 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.948488 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.948491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.949532 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.949545 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.950343 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.950347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.950477 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.950970 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:21.950983 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:21.952672 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:21.954750 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.954756 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.954762 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.955057 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.955413 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:21.955420 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:21.955426 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:21.955546 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:21.955964 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:21.955971 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:21.956110 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.956242 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.956450 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219}
I20260807 15:20:21.958456 25690 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.242.252:39519: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9"
member_type: NON_VOTER
last_known_addr {
host: "127.15.242.252"
port: 39519
}
attrs {
promote: true
}
}
dest_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1"
cas_config_opid_index: 5
I20260807 15:20:21.959088 25690 consensus_queue.cc:237] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } }
I20260807 15:20:21.960294 26546 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.961745 26745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:21.962263 26546 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.242.252:39519
I20260807 15:20:21.962483 26546 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.962604 26546 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:21.963646 26745 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Refusing update from remote peer a35eaf2a50e44728b18c5e9e914ca8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 15:20:21.965520 26547 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:21.966413 26564 master.cc:537] Master@127.15.242.252:39519 shutting down...
I20260807 15:20:21.967007 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.960931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37078 (local address 127.15.242.253:40251)
0807 15:20:21.961066 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.961071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.961555 (+ 484us) server_negotiation.cc:407] Connection header received
0807 15:20:21.961792 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.961796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.961873 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.961962 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:21.962519 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.963320 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.965253 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.965956 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.966067 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.966239 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:21.966767 (+ 528us) server_negotiation.cc:299] Negotiation successful
0807 15:20:21.966866 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 15:20:21.967566 26543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.960604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.0.0.1:37078)
0807 15:20:21.961475 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.961491 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.961645 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.962209 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.962214 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.962235 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:21.962338 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.962345 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.963623 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.963641 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.965055 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.965068 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.966419 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.966424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.966550 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:21.966605 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 15:20:21.967317 (+ 712us) client_negotiation.cc:240] Negotiation successful
0807 15:20:21.967419 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790}
I20260807 15:20:21.968111 26617 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 LEARNER]: Refusing update from remote peer a35eaf2a50e44728b18c5e9e914ca8d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20260807 15:20:21.968592 25667 consensus_peers.cc:487] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 -> Peer d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252:39519): Couldn't send request to peer d4f83163231b4693b63a4e9b2f738de9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:20:21.968717 26547 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 15:20:21.971258 26617 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.973241 26658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader a35eaf2a50e44728b18c5e9e914ca8d1. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.973395 26658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: This master's current role is: LEARNER
I20260807 15:20:21.973563 26658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: NON_VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: true } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.973675 26658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: This master's current role is: LEARNER
I20260807 15:20:21.973738 26547 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: attempting to promote NON_VOTER 89ed8a733e7b4a3e9fbff646a5eb25ab to VOTER
I20260807 15:20:21.974261 26547 consensus_queue.cc:237] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } }
I20260807 15:20:21.975775 26564 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:21.976140 26564 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:21.976290 26564 tablet_replica.cc:330] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: stopping tablet replica
W20260807 15:20:21.976910 25667 consensus_peers.cc:487] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 -> Peer d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252:39519): Couldn't send request to peer d4f83163231b4693b63a4e9b2f738de9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 15:20:21.977236 26617 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 LEARNER]: Refusing update from remote peer a35eaf2a50e44728b18c5e9e914ca8d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 15:20:21.977706 26546 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 15:20:21.980120 26546 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 89ed8a733e7b4a3e9fbff646a5eb25ab (127.15.242.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.981706 26546 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.981825 26546 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:21.983134 26547 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.983278 26547 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:21.984017 26615 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 89ed8a733e7b4a3e9fbff646a5eb25ab (127.15.242.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.984917 26564 master.cc:552] Master@127.15.242.252:39519 shutdown complete.
I20260807 15:20:21.984995 26564 master_runner.cc:305] Clearing existing system tablet
I20260807 15:20:21.985296 26564 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:21.985394 26564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:21.985950 26825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:21.986093 26825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:20:21.987128 26564 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:21.988097 26831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:21.988363 26564 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:21.988613 26564 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:21.988670 26564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
uuid: "d4f83163231b4693b63a4e9b2f738de9"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "345a1edb98e513f012acbdddb879cebd"
server_key_iv: "1eeee1bd164239a3c3c77862d63a7a3e"
server_key_version: "encryptionkey@0"
I20260807 15:20:21.990564 26564 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:21.993796 26564 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 15:20:21.993907 26564 log.cc:1196] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 15:20:21.994221 26564 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Deleting consensus metadata
I20260807 15:20:21.994414 26564 master_runner.cc:315] Copying system tablet from 127.15.242.254:44795
I20260807 15:20:21.995862 26564 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: tablet copy: Beginning tablet copy session from remote peer at address 127.15.242.254:44795
I20260807 15:20:22.011355 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.996490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:55464)
0807 15:20:21.996988 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:21.997007 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:21.997141 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:21.997550 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:21.997554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:21.997809 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:21.997933 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.997942 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.999219 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:21.999223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:21.999980 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:21.999990 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.000784 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.000789 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.000886 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.001595 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.001612 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.002222 (+ 610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.008933 (+ 6711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.008941 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.008947 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.009336 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.009947 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.009954 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.009959 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.010078 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.010652 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.010657 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.010771 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.010905 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.011098 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":116,"threads_started":1}
I20260807 15:20:22.011404 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:21.996613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55464 (local address 127.15.242.254:44795)
0807 15:20:21.996875 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:21.996882 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:21.997080 (+ 198us) server_negotiation.cc:407] Connection header received
0807 15:20:21.997251 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:21.997255 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:21.997313 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:21.997401 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:21.998084 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:21.999082 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.000123 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.000587 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.000738 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.002495 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.002500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.002542 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.002574 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.008702 (+ 6128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.009500 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.009507 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.009512 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.009775 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.010214 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.010218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.010220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.010445 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.010547 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.010986 (+ 439us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.011120 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 15:20:22.012334 25712 tablet_copy_service.cc:140] P a35eaf2a50e44728b18c5e9e914ca8d1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d4f83163231b4693b63a4e9b2f738de9 ({username='oryx', principal='oryx/127.15.242.252@KRBTEST.COM'} at 127.0.0.1:55464)
I20260807 15:20:22.012480 25712 tablet_copy_service.cc:161] P a35eaf2a50e44728b18c5e9e914ca8d1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d4f83163231b4693b63a4e9b2f738de9 at {username='oryx', principal='oryx/127.15.242.252@KRBTEST.COM'} at 127.0.0.1:55464: session id = d4f83163231b4693b63a4e9b2f738de9-00000000000000000000000000000000
I20260807 15:20:22.013549 25712 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 15:20:22.014986 26564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 15:20:22.017168 26564 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: tablet copy: Starting download of 0 data blocks...
I20260807 15:20:22.017401 26564 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: tablet copy: Starting download of 1 WAL segments...
I20260807 15:20:22.019156 26564 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 15:20:22.020987 25712 tablet_copy_service.cc:342] P a35eaf2a50e44728b18c5e9e914ca8d1: Request end of tablet copy session d4f83163231b4693b63a4e9b2f738de9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.242.252@KRBTEST.COM'} at 127.0.0.1:55464
I20260807 15:20:22.021097 25712 tablet_copy_service.cc:433] P a35eaf2a50e44728b18c5e9e914ca8d1: ending tablet copy session d4f83163231b4693b63a4e9b2f738de9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d4f83163231b4693b63a4e9b2f738de9
I20260807 15:20:22.028990 26564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:22.030916 26841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:22.033994 26842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:22.034049 26844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:22.034663 26187 heartbeater.cc:503] Master 127.15.242.254:44795 was elected leader, sending a full tablet report...
I20260807 15:20:22.040997 26564 server_base.cc:1034] running on GCE node
I20260807 15:20:22.041230 26564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:22.041643 26564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:22.042819 26564 hybrid_clock.cc:648] HybridClock initialized: now 1786116022042798 us; error 40 us; skew 500 ppm
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:22.044576 26564 init.cc:377] Logged in from keytab as oryx/127.15.242.252@KRBTEST.COM (short username oryx)
I20260807 15:20:22.045224 26564 webserver.cc:460] Webserver started at http://127.15.242.252:41097/ using document root <none> and password file <none>
I20260807 15:20:22.045467 26564 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:22.045531 26564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:22.046854 26564 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:22.047968 26858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.048239 26564 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:22.048349 26564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
uuid: "d4f83163231b4693b63a4e9b2f738de9"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "345a1edb98e513f012acbdddb879cebd"
server_key_iv: "1eeee1bd164239a3c3c77862d63a7a3e"
server_key_version: "encryptionkey@0"
I20260807 15:20:22.048467 26564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:22.064420 26564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:22.067677 26564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:22.073469 26564 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.252:39519
I20260807 15:20:22.073486 26937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.252:39519 every 8 connection(s)
I20260807 15:20:22.074113 26564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
I20260807 15:20:22.075713 26938 sys_catalog.cc:263] Verifying existing consensus state
I20260807 15:20:22.076648 26938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Bootstrap starting.
I20260807 15:20:22.086606 26938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:20:22.086956 26938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: Bootstrap complete.
I20260807 15:20:22.087496 26938 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } }
I20260807 15:20:22.087656 26938 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d4f83163231b4693b63a4e9b2f738de9, State: Initialized, Role: LEARNER
I20260807 15:20:22.087802 26938 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } }
I20260807 15:20:22.088176 26942 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:22.088354 26938 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:22.088397 26942 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: This master's current role is: LEARNER
I20260807 15:20:22.092463 26957 catalog_manager.cc:1259] Loaded cluster ID: 6be3e683a328480793754c8f5653ef8a
I20260807 15:20:22.092551 26957 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: loading cluster ID for follower catalog manager: success
I20260807 15:20:22.094278 26957 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: acquiring CA information for follower catalog manager: success
I20260807 15:20:22.095472 26957 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 15:20:22.136502 26822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:22.136896 26822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:22.136976 26822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:22.142181 26822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:22.142246 26822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:22.142311 26822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:22.147583 26822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab
--principal=oryx/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:43793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=38511
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251,127.15.242.252:39519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:22.148633 26822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:22.149714 26822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:22.159874 26967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:22.159830 26965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:22.159904 26964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:22.160065 26822 server_base.cc:1034] running on GCE node
I20260807 15:20:22.160612 26822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:22.161361 26822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:22.162568 26822 hybrid_clock.cc:648] HybridClock initialized: now 1786116022162532 us; error 53 us; skew 500 ppm
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:22.165635 26822 init.cc:377] Logged in from keytab as oryx/127.15.242.193@KRBTEST.COM (short username oryx)
I20260807 15:20:22.166512 26822 webserver.cc:460] Webserver started at http://127.15.242.193:38511/ using document root <none> and password file <none>
I20260807 15:20:22.167079 26822 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:22.167158 26822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:22.171329 26822 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 15:20:22.173730 26978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.175082 26822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 15:20:22.175217 26822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "6d264750702440a4b29f210b803c7c90"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "2dff677d69d7b1b30370a51e6dc5736d"
server_key_iv: "d07235fe55b089be132e6ffe2cd931b5"
server_key_version: "encryptionkey@0"
I20260807 15:20:22.175827 26822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:22.196945 26822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:22.200345 26822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:22.200563 26822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:22.201300 26822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:22.202278 26822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:22.202342 26822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.202414 26822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:22.202450 26822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.212973 26822 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:43793
I20260807 15:20:22.213029 27159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:43793 every 8 connection(s)
I20260807 15:20:22.214118 26822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:22.223774 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 26822
I20260807 15:20:22.223996 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 25991
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.252@KRBTEST.COM
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.253@KRBTEST.COM
I20260807 15:20:22.233898 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.218130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:33025 (local address 127.15.242.254:44795)
0807 15:20:22.218274 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.218279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.218469 (+ 190us) server_negotiation.cc:407] Connection header received
0807 15:20:22.218827 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.218833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.218905 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.218968 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.220435 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.221421 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223210 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.223549 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223634 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.228975 (+ 5341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.228980 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.228983 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.229017 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.231197 (+ 2180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.231901 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.231906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.231911 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.231995 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.232467 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.232473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.232478 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.232736 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.232842 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.233589 (+ 747us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.233726 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 15:20:22.235569 27171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.216468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39519 (local address 127.15.242.193:48003)
0807 15:20:22.217499 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.217541 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.218565 (+ 1024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.219269 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.219277 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.219714 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.220253 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.220268 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.221472 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.221475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.222840 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.222851 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.223806 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.224156 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.224925 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.224946 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.226471 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.231838 (+ 5367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.231841 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.231844 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.232081 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.232746 (+ 665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.232749 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.232750 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.232862 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.233767 (+ 905us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.233770 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.233854 (+ 84us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.234831 (+ 977us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.234963 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":232,"thread_start_us":689,"threads_started":1}
I20260807 15:20:22.236349 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.218594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:53797 (local address 127.15.242.253:40251)
0807 15:20:22.218789 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.218793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.218903 (+ 110us) server_negotiation.cc:407] Connection header received
0807 15:20:22.219092 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.219099 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.219161 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.219220 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.220435 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.221421 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223222 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.223536 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223661 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.229284 (+ 5623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.229291 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.229295 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.229328 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.231197 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.232989 (+ 1792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.232992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.232993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.233076 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.234233 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.234236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.234238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.234464 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.234539 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.236078 (+ 1539us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.236209 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260807 15:20:22.236994 27169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.216059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:48003 (local address 127.15.242.252:39519)
0807 15:20:22.216328 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.216343 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.217657 (+ 1314us) server_negotiation.cc:407] Connection header received
0807 15:20:22.218885 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.218895 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.218944 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.219051 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.220406 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.221270 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223008 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.223455 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223559 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.226657 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.226661 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.226664 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.226719 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.231707 (+ 4988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.232535 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.232538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.232539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.232621 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.233378 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.233381 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.233383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.233615 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.233721 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.236683 (+ 2962us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.236868 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":115,"threads_started":1}
I20260807 15:20:22.235867 27173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.217993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:33025)
0807 15:20:22.218370 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.218388 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.218572 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.219270 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.219278 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.219749 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.220266 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.220277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.221539 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.221545 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.223045 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.223057 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.223806 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.224624 (+ 814us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.226853 (+ 2229us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.226871 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.228808 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.231394 (+ 2586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.231403 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.231422 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.231788 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.232118 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.232124 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.232127 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.232343 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.232927 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.232935 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.233300 (+ 365us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.234095 (+ 795us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.234474 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":809,"spinlock_wait_cycles":11136,"thread_start_us":120,"threads_started":1}
I20260807 15:20:22.236331 27174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.218463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.15.242.193:53797)
0807 15:20:22.218816 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.218831 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.218974 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.219392 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.219399 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.219760 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.220268 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.220277 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.221795 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.221801 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.223070 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.223076 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.223813 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.223817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.224623 (+ 806us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.227082 (+ 2459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.227099 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.229103 (+ 2004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.232199 (+ 3096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.232201 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.232203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.232433 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.233189 (+ 756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.233192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.233194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.233276 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.234614 (+ 1338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.234616 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.234714 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.235995 (+ 1281us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.236143 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":774,"spinlock_wait_cycles":14336,"thread_start_us":94,"threads_started":1}
I20260807 15:20:22.238775 27163 heartbeater.cc:347] Connected to a master server at 127.15.242.252:39519
I20260807 15:20:22.238979 27164 heartbeater.cc:347] Connected to a master server at 127.15.242.253:40251
I20260807 15:20:22.239048 27164 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.239048 27163 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.239720 27163 heartbeater.cc:511] Master 127.15.242.252:39519 requested a full tablet report, sending...
I20260807 15:20:22.239720 27164 heartbeater.cc:511] Master 127.15.242.253:40251 requested a full tablet report, sending...
I20260807 15:20:22.241695 26881 ts_manager.cc:194] Registered new tserver with Master: 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793)
I20260807 15:20:22.241861 26604 ts_manager.cc:194] Registered new tserver with Master: 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793)
I20260807 15:20:22.248114 27162 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44795
I20260807 15:20:22.248267 27162 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.248509 27162 heartbeater.cc:511] Master 127.15.242.254:44795 requested a full tablet report, sending...
I20260807 15:20:22.249492 25690 ts_manager.cc:194] Re-registered known tserver with Master: 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793)
I20260807 15:20:22.250195 25690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:33025
I20260807 15:20:22.255548 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:38723
--local_ip_for_outbound_sockets=127.15.242.194
--tserver_master_addrs=127.15.242.254:44795
--webserver_port=35137
--webserver_interface=127.15.242.194
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab
--principal=oryx/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251,127.15.242.252:39519 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:20:22.278307 26394 heartbeater.cc:503] Master 127.15.242.254:44795 was elected leader, sending a full tablet report...
W20260807 15:20:22.378388 27175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:22.378691 27175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:22.378772 27175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:22.383212 27175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:22.383309 27175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:22.383405 27175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:22.389040 27175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab
--principal=oryx/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:38723
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=35137
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251,127.15.242.252:39519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:22.390161 27175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:22.391347 27175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:22.401628 27181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:22.401708 27185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:22.401703 27183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:22.402647 27175 server_base.cc:1034] running on GCE node
I20260807 15:20:22.403075 27175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:22.403719 27175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:22.404906 27175 hybrid_clock.cc:648] HybridClock initialized: now 1786116022404877 us; error 42 us; skew 500 ppm
I20260807 15:20:22.405963 27169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.402044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.15.242.252:39519)
0807 15:20:22.402198 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.402201 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.402215 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:22.402300 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.402305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.402389 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.402492 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:22.402870 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.403460 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.404893 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.405414 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.405554 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.405708 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.405755 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.405831 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 15:20:22.405963 26543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.401610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39519 (local address 127.0.0.1:40914)
0807 15:20:22.401852 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.401870 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.401978 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.402531 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.402535 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.402561 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:22.402708 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.402714 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.403573 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.403580 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.404706 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.404717 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.405554 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.405558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.405652 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.405676 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.405744 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.405826 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127}
I20260807 15:20:22.407122 26896 raft_consensus.cc:1203] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:22.407752 26942 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a35eaf2a50e44728b18c5e9e914ca8d1. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:22.407912 26942 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: This master's current role is: LEARNER
I20260807 15:20:22.408233 27175 init.cc:377] Logged in from keytab as oryx/127.15.242.194@KRBTEST.COM (short username oryx)
I20260807 15:20:22.409227 27175 webserver.cc:460] Webserver started at http://127.15.242.194:35137/ using document root <none> and password file <none>
I20260807 15:20:22.409824 27175 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:22.409929 27175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:22.413889 27175 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 15:20:22.416083 27200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.417655 27175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:22.417793 27175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "1820be41aaf54e17b2636f9133f451a8"
format_stamp: "Formatted at 2026-08-07 15:20:20 on dist-test-slave-g170"
server_key: "254c99e393c8f3d365c94e494ad8cdca"
server_key_iv: "71879defb50508dbc5cd89981f62cb52"
server_key_version: "encryptionkey@0"
I20260807 15:20:22.418371 27175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:22.434453 27175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:22.438397 27175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:22.438622 27175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:22.439301 27175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:22.440240 27175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:22.440313 27175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.440382 27175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:22.440411 27175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.450471 27175 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:38723
I20260807 15:20:22.450495 27379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:38723 every 8 connection(s)
I20260807 15:20:22.451534 27175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:22.453191 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 27175
I20260807 15:20:22.453384 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 26193
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.252@KRBTEST.COM
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.253@KRBTEST.COM
I20260807 15:20:22.478667 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.460367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:35283 (local address 127.15.242.253:40251)
0807 15:20:22.460495 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.460499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.462858 (+ 2359us) server_negotiation.cc:407] Connection header received
0807 15:20:22.463167 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.463175 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.463273 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.463356 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.464739 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.466007 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.468037 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.468614 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.468735 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.473474 (+ 4739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.473482 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.473489 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.473535 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.476008 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.476608 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.476614 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.476618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.476713 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.477179 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.477185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.477189 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.477448 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.477523 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.478263 (+ 740us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.478437 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:20:22.479115 27169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.459973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:59405 (local address 127.15.242.252:39519)
0807 15:20:22.460124 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.460129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.461663 (+ 1534us) server_negotiation.cc:407] Connection header received
0807 15:20:22.462330 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.462334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.462393 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.462449 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.464697 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.465556 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.467680 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.468033 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.468112 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.473412 (+ 5300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.473417 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.473420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.473452 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.476160 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.476945 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.476953 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.476958 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.477113 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.477609 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.477616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.477621 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.477961 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.478084 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.478659 (+ 575us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.478845 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 15:20:22.479885 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.453984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:57287 (local address 127.15.242.254:44795)
0807 15:20:22.458861 (+ 4877us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.458873 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.460614 (+ 1741us) server_negotiation.cc:407] Connection header received
0807 15:20:22.462330 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.462334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.462393 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.462449 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.464708 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.465556 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.467686 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.468033 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.468112 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.473412 (+ 5300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.473417 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.473420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.473452 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.475831 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.478210 (+ 2379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.478215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.478216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.478335 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.478695 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.478700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.478702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.478962 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.479061 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.479560 (+ 499us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.479718 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4759}
I20260807 15:20:22.480899 27386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.459853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39519 (local address 127.15.242.194:59405)
0807 15:20:22.461570 (+ 1717us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.461583 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.462064 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.462888 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.462898 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.463547 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.464511 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.464532 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.465757 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.465760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.467529 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.467541 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.468335 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.468340 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.468634 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.469796 (+ 1162us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.469820 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.473180 (+ 3360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.476357 (+ 3177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.476365 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.476371 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.476755 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.477297 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.477304 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.477310 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.477447 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.478172 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.478178 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.478362 (+ 184us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.479411 (+ 1049us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.479644 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1636,"mutex_wait_us":509,"spinlock_wait_cycles":4992,"thread_start_us":85,"threads_started":1}
I20260807 15:20:22.480897 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.460589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.15.242.194:35283)
0807 15:20:22.462720 (+ 2131us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.462743 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.462983 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.463581 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.463588 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.463895 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.464515 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.464543 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.466362 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.466370 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.467839 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.467856 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.469017 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.469022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.469203 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.469992 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.470018 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.473250 (+ 3232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.476142 (+ 2892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.476145 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.476147 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.476471 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.476854 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.476859 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.476863 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.477062 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.477615 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.477624 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.477954 (+ 330us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.478982 (+ 1028us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.479518 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2026,"mutex_wait_us":46,"thread_start_us":701,"threads_started":1}
I20260807 15:20:22.481279 27387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.454172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:57287)
0807 15:20:22.460386 (+ 6214us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.460481 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.462064 (+ 1583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.462888 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.462898 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.463547 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.464511 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.464532 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.465757 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.465760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.467528 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.467541 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.468335 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.468340 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.468642 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.469781 (+ 1139us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.469808 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.473180 (+ 3372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.476001 (+ 2821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.476008 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.476026 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.478060 (+ 2034us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.478481 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.478484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.478486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.478578 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.479231 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.479235 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.479342 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.480162 (+ 820us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.480316 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5848,"mutex_wait_us":338,"spinlock_wait_cycles":10624,"thread_start_us":1654,"threads_started":1}
I20260807 15:20:22.482652 27380 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44795
I20260807 15:20:22.482689 27381 heartbeater.cc:347] Connected to a master server at 127.15.242.252:39519
I20260807 15:20:22.482965 27381 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.482970 27380 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.483659 27381 heartbeater.cc:511] Master 127.15.242.252:39519 requested a full tablet report, sending...
I20260807 15:20:22.483660 27380 heartbeater.cc:511] Master 127.15.242.254:44795 requested a full tablet report, sending...
I20260807 15:20:22.486145 26881 ts_manager.cc:194] Registered new tserver with Master: 1820be41aaf54e17b2636f9133f451a8 (127.15.242.194:38723)
I20260807 15:20:22.486713 25690 ts_manager.cc:194] Re-registered known tserver with Master: 1820be41aaf54e17b2636f9133f451a8 (127.15.242.194:38723)
I20260807 15:20:22.487402 25690 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:57287
I20260807 15:20:22.490669 27383 heartbeater.cc:347] Connected to a master server at 127.15.242.253:40251
I20260807 15:20:22.490816 27383 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.491118 27383 heartbeater.cc:511] Master 127.15.242.253:40251 requested a full tablet report, sending...
I20260807 15:20:22.492095 26604 ts_manager.cc:194] Registered new tserver with Master: 1820be41aaf54e17b2636f9133f451a8 (127.15.242.194:38723)
I20260807 15:20:22.497841 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:39175
--local_ip_for_outbound_sockets=127.15.242.195
--tserver_master_addrs=127.15.242.254:44795
--webserver_port=35693
--webserver_interface=127.15.242.195
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab
--principal=oryx/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251,127.15.242.252:39519 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:22.613837 27392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:22.614094 27392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:22.614135 27392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:22.618124 27392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:22.618175 27392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:22.618275 27392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:22.623772 27392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab
--principal=oryx/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:39175
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=35693
--tserver_master_addrs=127.15.242.254:44795,127.15.242.253:40251,127.15.242.252:39519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:22.624845 27392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:22.625854 27392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:22.635566 27404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:22.635568 27397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:22.635576 27401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:22.635896 27392 server_base.cc:1034] running on GCE node
I20260807 15:20:22.636312 27392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:22.637015 27392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:22.638219 27392 hybrid_clock.cc:648] HybridClock initialized: now 1786116022638201 us; error 28 us; skew 500 ppm
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:22.641083 27392 init.cc:377] Logged in from keytab as oryx/127.15.242.195@KRBTEST.COM (short username oryx)
I20260807 15:20:22.641933 27392 webserver.cc:460] Webserver started at http://127.15.242.195:35693/ using document root <none> and password file <none>
I20260807 15:20:22.642464 27392 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:22.642537 27392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:22.646541 27392 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 15:20:22.648895 27416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.650249 27392 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:20:22.650382 27392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "15fbb376d0074f4ba98944cf7fa3f5b4"
format_stamp: "Formatted at 2026-08-07 15:20:21 on dist-test-slave-g170"
server_key: "c9693ec1d1e9e5603178e48e4cc26440"
server_key_iv: "b186b017b507c2ca435da968dab3e8ee"
server_key_version: "encryptionkey@0"
I20260807 15:20:22.650935 27392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:22.665940 27392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:22.669351 27392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:22.669549 27392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:22.670222 27392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:22.671123 27392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:22.671180 27392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.671222 27392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:22.671272 27392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:22.681447 27392 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:39175
I20260807 15:20:22.681493 27580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:39175 every 8 connection(s)
I20260807 15:20:22.682708 27392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:22.685218 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 27392
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.252@KRBTEST.COM
Aug 07 15:20:22 dist-test-slave-g170 krb5kdc[25621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116022, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.253@KRBTEST.COM
I20260807 15:20:22.703039 27599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.687736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37080 (local address 127.15.242.253:40251)
0807 15:20:22.688811 (+ 1075us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.688816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.688973 (+ 157us) server_negotiation.cc:407] Connection header received
0807 15:20:22.689132 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.689136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.689192 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.689295 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.692608 (+ 3313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.693403 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.695023 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.695426 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.695547 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.697913 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.697918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.697924 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.697955 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.700086 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.700791 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.700796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.700798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.700905 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.701226 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.701230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.701232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.701584 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.701728 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.702563 (+ 835us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.702835 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":956,"thread_start_us":91,"threads_started":1}
I20260807 15:20:22.704119 27601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.688201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40930 (local address 127.15.242.252:39519)
0807 15:20:22.688441 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.688445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.689486 (+ 1041us) server_negotiation.cc:407] Connection header received
0807 15:20:22.689541 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.689546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.689598 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.689689 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.690979 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.691902 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.695679 (+ 3777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.696069 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.696167 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.699346 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.699350 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.699352 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.699384 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.701740 (+ 2356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.702222 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.702226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.702227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.702333 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.702909 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.702912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.702914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.703147 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.703267 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.703829 (+ 562us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.703959 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":105,"threads_started":1}
I20260807 15:20:22.704411 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.684807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:50905 (local address 127.15.242.254:44795)
0807 15:20:22.684968 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.684974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.686544 (+ 1570us) server_negotiation.cc:407] Connection header received
0807 15:20:22.688557 (+ 2013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.688561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.688612 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.688687 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.690536 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.691351 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.693248 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.693610 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.693708 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.697556 (+ 3848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.697560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.697563 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.697590 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.701091 (+ 3501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.701897 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.701904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.701909 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.702007 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.702535 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.702540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.702541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.702803 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.702894 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.704042 (+ 1148us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.704199 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":35}
I20260807 15:20:22.705821 27597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.687333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55478 (local address 127.15.242.254:44795)
0807 15:20:22.690314 (+ 2981us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.690318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.690333 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:20:22.690374 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.690379 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.690432 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.690533 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.691465 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.692221 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.693361 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.693967 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.694053 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.696191 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.696195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.696198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.696225 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.700065 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.702463 (+ 2398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.702466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.702468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.702560 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.704497 (+ 1937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.704502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.704506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.704739 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.704889 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.705593 (+ 704us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.705701 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":2899,"thread_start_us":79,"threads_started":1}
I20260807 15:20:22.706812 27588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.685227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.195:50905)
0807 15:20:22.686365 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.686425 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.688331 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.689051 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.689060 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.689643 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.690365 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.690386 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.691567 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.691573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.693097 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.693106 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.693762 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.693765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.693958 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.694632 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.694656 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.697367 (+ 2711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.701247 (+ 3880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.701256 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.701280 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.701760 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.702149 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.702152 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.702154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.702401 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.703107 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.703115 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.703493 (+ 378us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.705169 (+ 1676us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.705598 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":848,"thread_start_us":662,"threads_started":1}
I20260807 15:20:22.708388 27581 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44795
I20260807 15:20:22.708655 27581 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.709290 27581 heartbeater.cc:511] Master 127.15.242.254:44795 requested a full tablet report, sending...
I20260807 15:20:22.709338 27169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.687564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:47935 (local address 127.15.242.252:39519)
0807 15:20:22.687705 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.687709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.691363 (+ 3654us) server_negotiation.cc:407] Connection header received
0807 15:20:22.691856 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.691860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.691925 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.691978 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.693433 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.694159 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.697823 (+ 3664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.698196 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.698278 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.703489 (+ 5211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.703492 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.703495 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.703519 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.706050 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.707118 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.707121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.707122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.707216 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.708400 (+ 1184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.708403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.708405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.708635 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.708733 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.709100 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.709231 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 15:20:22.709838 27594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.686831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39519 (local address 127.15.242.195:47935)
0807 15:20:22.691267 (+ 4436us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.691281 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.691738 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.692114 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.692116 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.692331 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.693325 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.693330 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.694315 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.694318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.695157 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.695170 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.698443 (+ 3273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.698445 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.698516 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.699939 (+ 1423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.699960 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.702966 (+ 3006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.706634 (+ 3668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.706637 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.706639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.706909 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.707707 (+ 798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.707722 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.707725 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.708307 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.708813 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.708817 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.708909 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.709557 (+ 648us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.709702 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4370,"thread_start_us":81,"threads_started":1}
I20260807 15:20:22.710677 27583 heartbeater.cc:347] Connected to a master server at 127.15.242.252:39519
I20260807 15:20:22.710768 27583 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.710958 27583 heartbeater.cc:511] Master 127.15.242.252:39519 requested a full tablet report, sending...
I20260807 15:20:22.711688 26881 ts_manager.cc:194] Registered new tserver with Master: 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175)
I20260807 15:20:22.709084 25690 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55478:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 15:20:22.713263 25687 ts_manager.cc:194] Re-registered known tserver with Master: 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175)
W20260807 15:20:22.713313 25690 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:22.713594 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.687224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.15.242.195:60307)
0807 15:20:22.691541 (+ 4317us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.691555 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.692545 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.692918 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.692921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.693097 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:22.693240 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.693247 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.696829 (+ 3582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.696832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.697672 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.697684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.699530 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.699537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.699677 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.701403 (+ 1726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:22.701416 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:22.703319 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:22.707327 (+ 4008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.707330 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.707332 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.707589 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.707927 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:22.707930 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:22.707932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:22.708539 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:22.713046 (+ 4507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:22.713049 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:22.713135 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.713256 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.713416 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4250,"thread_start_us":72,"threads_started":1}
I20260807 15:20:22.713609 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.687300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:60307 (local address 127.15.242.253:40251)
0807 15:20:22.687446 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.687451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.691620 (+ 4169us) server_negotiation.cc:407] Connection header received
0807 15:20:22.692677 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.692680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.692722 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.692790 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.695321 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.695846 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.698850 (+ 3004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.699238 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.699325 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.703865 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.703870 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.703874 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.703904 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.706966 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.707711 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.707715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.707717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.707798 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.708660 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.708667 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.708672 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.708932 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.709035 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.713340 (+ 4305us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.713468 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:20:22.714025 25687 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:50905
I20260807 15:20:22.715293 27586 heartbeater.cc:347] Connected to a master server at 127.15.242.253:40251
I20260807 15:20:22.715401 27586 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:22.715562 27586 heartbeater.cc:511] Master 127.15.242.253:40251 requested a full tablet report, sending...
I20260807 15:20:22.716325 26604 ts_manager.cc:194] Registered new tserver with Master: 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175)
I20260807 15:20:22.716894 27608 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: NON_VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: true } } }
I20260807 15:20:22.717047 27608 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:22.720317 27608 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: attempting to promote NON_VOTER d4f83163231b4693b63a4e9b2f738de9 to VOTER
I20260807 15:20:22.720724 27608 consensus_queue.cc:237] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } }
I20260807 15:20:22.722143 26896 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 LEARNER]: Refusing update from remote peer a35eaf2a50e44728b18c5e9e914ca8d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 15:20:22.722263 26615 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Refusing update from remote peer a35eaf2a50e44728b18c5e9e914ca8d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 15:20:22.722688 27608 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 15:20:22.722994 27608 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 15:20:22.724599 26828 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:22.725137 26615 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:22.725023 26896 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:22.726253 26828 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:22.726361 26828 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:22.726527 26828 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:22.726627 26828 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:22.726773 27606 sys_catalog.cc:455] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:22.726866 27606 sys_catalog.cc:458] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:22.726965 26942 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:22.727080 26942 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:20:22.728644 27622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:22.728844 27622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:20:22.738714 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.732718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40848 (local address 127.15.242.195:39175)
0807 15:20:22.733256 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.733303 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.733338 (+ 35us) server_negotiation.cc:407] Connection header received
0807 15:20:22.733464 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.733471 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.733769 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.734123 (+ 354us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:22.734353 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.735702 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.737152 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.738062 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.738227 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.738415 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.738477 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.738572 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":211,"threads_started":1}
I20260807 15:20:22.738752 27625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.732676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:43793 (local address 127.0.0.1:60004)
0807 15:20:22.732982 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.732998 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.733101 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.733997 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.734000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.734014 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:22.734484 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.734493 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.735912 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.735915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.737114 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.737123 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.738265 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.738269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.738429 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.738456 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.738522 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.738594 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":406,"thread_start_us":138,"threads_started":1}
I20260807 15:20:22.739068 26543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.731999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:38723 (local address 127.0.0.1:48750)
0807 15:20:22.732150 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.732168 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.732271 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.734074 (+ 1803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.734078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.734106 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:22.734237 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.734244 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.735557 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.735563 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.736682 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.736693 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.738265 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.738269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.738787 (+ 518us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.738803 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.738892 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.738962 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":377,"spinlock_wait_cycles":2816}
I20260807 15:20:22.738708 27624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.732272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:39175 (local address 127.0.0.1:40848)
0807 15:20:22.732546 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.732561 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.732665 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.733975 (+ 1310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.733982 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.734003 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:22.734236 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.734244 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.735865 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.735873 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.736982 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.736993 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.738203 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.738208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.738316 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.738357 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.738434 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.738521 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":101,"thread_start_us":106,"threads_started":1}
I20260807 15:20:22.739295 27623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.732178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48750 (local address 127.15.242.194:38723)
0807 15:20:22.733304 (+ 1126us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.733329 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.733354 (+ 25us) server_negotiation.cc:407] Connection header received
0807 15:20:22.733467 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.733474 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.733907 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.734643 (+ 736us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:22.734763 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.735443 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.736971 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.738123 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.738453 (+ 330us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.738597 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.739018 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.739146 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":989,"thread_start_us":125,"threads_started":1}
I20260807 15:20:22.739740 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.733170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60004 (local address 127.15.242.193:43793)
0807 15:20:22.733511 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.733529 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.733551 (+ 22us) server_negotiation.cc:407] Connection header received
0807 15:20:22.733657 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.733662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.733838 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.734421 (+ 583us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:22.734574 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.735792 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.737249 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.738116 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.739270 (+ 1154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.739417 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.739469 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.739573 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":80,"threads_started":1}
I20260807 15:20:22.742192 27277 tablet_service.cc:1467] Processing CreateTablet for tablet f09cd86035d447e1a73db88eaf2acf75 (DEFAULT_TABLE table=test-table [id=0d0c1ef9ab384b4199ea6e916da13841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:22.742537 27486 tablet_service.cc:1467] Processing CreateTablet for tablet f09cd86035d447e1a73db88eaf2acf75 (DEFAULT_TABLE table=test-table [id=0d0c1ef9ab384b4199ea6e916da13841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:22.742537 27056 tablet_service.cc:1467] Processing CreateTablet for tablet f09cd86035d447e1a73db88eaf2acf75 (DEFAULT_TABLE table=test-table [id=0d0c1ef9ab384b4199ea6e916da13841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:22.743151 27277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f09cd86035d447e1a73db88eaf2acf75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:22.743682 27056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f09cd86035d447e1a73db88eaf2acf75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:22.743682 27486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f09cd86035d447e1a73db88eaf2acf75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:22.750514 27628 tablet_bootstrap.cc:492] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: Bootstrap starting.
I20260807 15:20:22.752630 27629 tablet_bootstrap.cc:492] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: Bootstrap starting.
I20260807 15:20:22.753000 27628 tablet_bootstrap.cc:654] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:22.754269 27628 log.cc:824] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:22.755234 27631 tablet_bootstrap.cc:492] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: Bootstrap starting.
I20260807 15:20:22.755295 27629 tablet_bootstrap.cc:654] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:22.756222 27629 log.cc:824] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:22.756909 27628 tablet_bootstrap.cc:492] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: No bootstrap required, opened a new log
I20260807 15:20:22.757120 27628 ts_tablet_manager.cc:1397] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 15:20:22.758450 27629 tablet_bootstrap.cc:492] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: No bootstrap required, opened a new log
I20260807 15:20:22.758641 27629 ts_tablet_manager.cc:1397] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:20:22.762099 27628 raft_consensus.cc:348] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.762485 27628 raft_consensus.cc:374] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:22.762559 27628 raft_consensus.cc:729] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1820be41aaf54e17b2636f9133f451a8, State: Initialized, Role: FOLLOWER
I20260807 15:20:22.762857 27631 tablet_bootstrap.cc:654] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:22.763083 27628 consensus_queue.cc:260] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.763461 27629 raft_consensus.cc:348] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.763748 27629 raft_consensus.cc:374] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:22.763697 27631 log.cc:824] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:22.763819 27629 raft_consensus.cc:729] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15fbb376d0074f4ba98944cf7fa3f5b4, State: Initialized, Role: FOLLOWER
I20260807 15:20:22.764302 27380 heartbeater.cc:503] Master 127.15.242.254:44795 was elected leader, sending a full tablet report...
I20260807 15:20:22.764389 27629 consensus_queue.cc:260] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.764619 27628 ts_tablet_manager.cc:1428] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:20:22.765475 27629 ts_tablet_manager.cc:1428] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 15:20:22.766043 27581 heartbeater.cc:503] Master 127.15.242.254:44795 was elected leader, sending a full tablet report...
I20260807 15:20:22.771320 27631 tablet_bootstrap.cc:492] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: No bootstrap required, opened a new log
I20260807 15:20:22.771601 27631 ts_tablet_manager.cc:1397] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260807 15:20:22.774827 27631 raft_consensus.cc:348] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.775108 27631 raft_consensus.cc:374] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:22.775208 27631 raft_consensus.cc:729] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d264750702440a4b29f210b803c7c90, State: Initialized, Role: FOLLOWER
I20260807 15:20:22.775748 27631 consensus_queue.cc:260] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.776547 27162 heartbeater.cc:503] Master 127.15.242.254:44795 was elected leader, sending a full tablet report...
I20260807 15:20:22.776953 27631 ts_tablet_manager.cc:1428] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 15:20:22.788667 27635 raft_consensus.cc:482] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:22.789005 27635 raft_consensus.cc:504] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.790442 27635 leader_election.cc:288] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175), 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793)
I20260807 15:20:22.796296 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.791187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:43879 (local address 127.15.242.195:39175)
0807 15:20:22.791331 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.791338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.791357 (+ 19us) server_negotiation.cc:407] Connection header received
0807 15:20:22.791422 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.791426 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.791486 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.791568 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:22.792066 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.792922 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.794883 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.795516 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.795657 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.795715 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.796068 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.796153 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 15:20:22.796305 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.790877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:58923 (local address 127.15.242.193:43793)
0807 15:20:22.791066 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.791073 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.791406 (+ 333us) server_negotiation.cc:407] Connection header received
0807 15:20:22.791558 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.791562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.791718 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.791795 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:22.792098 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.792922 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.794883 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.795518 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.795657 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.795715 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.796068 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.796153 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:20:22.796433 27386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.790774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:39175 (local address 127.15.242.194:43879)
0807 15:20:22.790945 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.790972 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.791082 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.791738 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.791741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.791760 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:22.791919 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.791929 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.793081 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.793085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.794693 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.794705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.795682 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.795687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.795861 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.795930 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.796024 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.796237 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":259}
I20260807 15:20:22.796435 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.790789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:43793 (local address 127.15.242.194:58923)
0807 15:20:22.791307 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:22.791324 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:22.791429 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:22.791818 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:22.791821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:22.791834 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:22.791976 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.791987 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.793081 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.793085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.794692 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:22.794711 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.795682 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.795739 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:22.795875 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.795930 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 15:20:22.796024 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 15:20:22.796240 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":597}
I20260807 15:20:22.797333 27518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f09cd86035d447e1a73db88eaf2acf75" candidate_uuid: "1820be41aaf54e17b2636f9133f451a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" is_pre_election: true
I20260807 15:20:22.797756 27518 raft_consensus.cc:2454] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1820be41aaf54e17b2636f9133f451a8 in term 0.
I20260807 15:20:22.798019 27090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f09cd86035d447e1a73db88eaf2acf75" candidate_uuid: "1820be41aaf54e17b2636f9133f451a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d264750702440a4b29f210b803c7c90" is_pre_election: true
I20260807 15:20:22.798405 27090 raft_consensus.cc:2454] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1820be41aaf54e17b2636f9133f451a8 in term 0.
I20260807 15:20:22.798592 27207 leader_election.cc:302] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15fbb376d0074f4ba98944cf7fa3f5b4, 1820be41aaf54e17b2636f9133f451a8; no voters:
I20260807 15:20:22.798954 27635 raft_consensus.cc:2781] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:22.799045 27635 raft_consensus.cc:482] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:22.799077 27635 raft_consensus.cc:3037] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:22.800185 27635 raft_consensus.cc:504] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.800560 27635 leader_election.cc:288] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [CANDIDATE]: Term 1 election: Requested vote from peers 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175), 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793)
I20260807 15:20:22.801035 27518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f09cd86035d447e1a73db88eaf2acf75" candidate_uuid: "1820be41aaf54e17b2636f9133f451a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4"
I20260807 15:20:22.801040 27090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f09cd86035d447e1a73db88eaf2acf75" candidate_uuid: "1820be41aaf54e17b2636f9133f451a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d264750702440a4b29f210b803c7c90"
I20260807 15:20:22.801216 27090 raft_consensus.cc:3037] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:22.801231 27518 raft_consensus.cc:3037] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:22.802597 27090 raft_consensus.cc:2454] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1820be41aaf54e17b2636f9133f451a8 in term 1.
I20260807 15:20:22.802711 27518 raft_consensus.cc:2454] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1820be41aaf54e17b2636f9133f451a8 in term 1.
I20260807 15:20:22.802909 27208 leader_election.cc:302] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1820be41aaf54e17b2636f9133f451a8, 6d264750702440a4b29f210b803c7c90; no voters:
I20260807 15:20:22.803143 27635 raft_consensus.cc:2781] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:22.803421 27635 raft_consensus.cc:686] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 1 LEADER]: Becoming Leader. State: Replica: 1820be41aaf54e17b2636f9133f451a8, State: Running, Role: LEADER
I20260807 15:20:22.803857 27635 consensus_queue.cc:237] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } }
I20260807 15:20:22.808454 25687 catalog_manager.cc:5495] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1820be41aaf54e17b2636f9133f451a8 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "1820be41aaf54e17b2636f9133f451a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } health_report { overall_health: UNKNOWN } } }
I20260807 15:20:22.827452 27623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.823481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48758 (local address 127.15.242.194:38723)
0807 15:20:22.823623 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.823630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.823654 (+ 24us) server_negotiation.cc:407] Connection header received
0807 15:20:22.823868 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.823871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.823942 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.824094 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:22.824360 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.825007 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.825898 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.826127 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.826248 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.826580 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:22.827027 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:22.827180 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.827218 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.827277 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 15:20:22.834329 27518 raft_consensus.cc:1261] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 1 FOLLOWER]: Refusing update from remote peer 1820be41aaf54e17b2636f9133f451a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:22.834329 27090 raft_consensus.cc:1261] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 1 FOLLOWER]: Refusing update from remote peer 1820be41aaf54e17b2636f9133f451a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:22.835244 27641 consensus_queue.cc:1035] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:22.835464 27635 consensus_queue.cc:1035] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:22.849164 27649 mvcc.cc:205] Tried to move back new op lower bound from 7315931229520900096 to 7315931229408010240. Current Snapshot: MvccSnapshot[applied={T|T < 7315931229520900096 or (T in {7315931229520900096})}]
I20260807 15:20:22.859172 25687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:22.859331 25687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:22.863758 25687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a35eaf2a50e44728b18c5e9e914ca8d1: Sending DeleteTablet for 3 replicas of tablet f09cd86035d447e1a73db88eaf2acf75
I20260807 15:20:22.864641 27486 tablet_service.cc:1514] Processing DeleteTablet for tablet f09cd86035d447e1a73db88eaf2acf75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:22 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:40848
I20260807 15:20:22.864842 27277 tablet_service.cc:1514] Processing DeleteTablet for tablet f09cd86035d447e1a73db88eaf2acf75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:22 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:48750
I20260807 15:20:22.865667 27669 tablet_replica.cc:330] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: stopping tablet replica
I20260807 15:20:22.865692 27056 tablet_service.cc:1514] Processing DeleteTablet for tablet f09cd86035d447e1a73db88eaf2acf75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:22 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:60004
I20260807 15:20:22.866051 27669 raft_consensus.cc:2229] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:22.866418 27669 raft_consensus.cc:2258] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:22.867254 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 25640
I20260807 15:20:22.870225 27669 ts_tablet_manager.cc:1905] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:22.873302 27669 ts_tablet_manager.cc:1918] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:22.873486 27669 log.cc:1196] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/f09cd86035d447e1a73db88eaf2acf75
I20260807 15:20:22.873860 27669 ts_tablet_manager.cc:1939] T f09cd86035d447e1a73db88eaf2acf75 P 15fbb376d0074f4ba98944cf7fa3f5b4: Deleting consensus metadata
I20260807 15:20:22.876600 27674 tablet_replica.cc:330] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: stopping tablet replica
I20260807 15:20:22.877089 27674 raft_consensus.cc:2229] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:22.877622 27674 raft_consensus.cc:2258] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:22.880046 27674 ts_tablet_manager.cc:1905] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:22.880439 27670 tablet_replica.cc:330] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: stopping tablet replica
I20260807 15:20:22.880901 27670 raft_consensus.cc:2229] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:20:22.881438 27670 raft_consensus.cc:2258] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:22.883772 27674 ts_tablet_manager.cc:1918] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:22.883899 27674 log.cc:1196] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/f09cd86035d447e1a73db88eaf2acf75
I20260807 15:20:22.884274 27674 ts_tablet_manager.cc:1939] T f09cd86035d447e1a73db88eaf2acf75 P 6d264750702440a4b29f210b803c7c90: Deleting consensus metadata
W20260807 15:20:22.888703 26985 connection.cc:535] server connection from 127.0.0.1:60004 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 15:20:22.889178 27418 connection.cc:535] server connection from 127.0.0.1:40848 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 15:20:22.891446 27670 ts_tablet_manager.cc:1905] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:22.894531 27670 ts_tablet_manager.cc:1918] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:22.894649 27670 log.cc:1196] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/f09cd86035d447e1a73db88eaf2acf75
I20260807 15:20:22.895053 27670 ts_tablet_manager.cc:1939] T f09cd86035d447e1a73db88eaf2acf75 P 1820be41aaf54e17b2636f9133f451a8: Deleting consensus metadata
W20260807 15:20:22.896304 27209 connection.cc:441] server connection from 127.0.0.1:48750 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48750 (request call id 1) could send its response
I20260807 15:20:22.899482 26794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.865741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37096 (local address 127.15.242.253:40251)
0807 15:20:22.865857 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.865862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.866138 (+ 276us) server_negotiation.cc:407] Connection header received
0807 15:20:22.866347 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.866351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.866401 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.866459 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.888539 (+ 22080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.889569 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.892262 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.892645 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.892729 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.895446 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.895450 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.895453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.895482 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.897426 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.898025 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.898028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.898030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.898130 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.898476 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.898480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.898482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.898687 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.898789 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.899149 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.899274 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 15:20:22.906267 27599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.893976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37108 (local address 127.15.242.253:40251)
0807 15:20:22.894098 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.894120 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.896870 (+ 2750us) server_negotiation.cc:407] Connection header received
0807 15:20:22.897029 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.897032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.897090 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.897179 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.898135 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.898947 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.900105 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.900430 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.900517 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.902401 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.902405 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.902408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.902433 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.904140 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.904644 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.904648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.904651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.904738 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.905131 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.905134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.905136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.905356 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.905470 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.905901 (+ 431us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.906059 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 15:20:22.907471 27601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.894632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40942 (local address 127.15.242.252:39519)
0807 15:20:22.894796 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.894801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.897237 (+ 2436us) server_negotiation.cc:407] Connection header received
0807 15:20:22.897426 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.897430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.897488 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.897544 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.898524 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.899411 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.900964 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.901371 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.901457 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.903226 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.903231 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.903234 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.903263 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.905198 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.905723 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.905727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.905729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.905822 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.906175 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.906179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.906181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.906390 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.906491 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.907100 (+ 609us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.907291 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 15:20:22.910512 27169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:22.866314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40934 (local address 127.15.242.252:39519)
0807 15:20:22.866428 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:22.866432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:22.900391 (+ 33959us) server_negotiation.cc:407] Connection header received
0807 15:20:22.900576 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:22.900580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:22.900637 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:22.900690 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:22.902341 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.903145 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.904407 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:22.904915 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:22.904996 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:22.906560 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:22.906564 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:22.906568 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:22.906600 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:22.908723 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.909247 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.909250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.909252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.909346 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:22.909639 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:22.909642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:22.909644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:22.909833 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:22.909969 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:22.910211 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 15:20:22.910334 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 15:20:23.849129 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:23.848450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:33179)
0807 15:20:23.848847 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:23.848991 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":83,"threads_started":1}
W20260807 15:20:23.849617 27162 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:44795 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:23.851555 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:23.850999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.195:60153)
0807 15:20:23.851327 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:23.851441 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":88,"threads_started":1}
I20260807 15:20:23.851563 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:23.850906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:53227)
0807 15:20:23.851351 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:23.851446 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":71,"threads_started":1}
W20260807 15:20:23.851862 27581 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:44795 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
W20260807 15:20:23.852007 27380 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:44795 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:24.364189 27693 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a35eaf2a50e44728b18c5e9e914ca8d1)
I20260807 15:20:24.364269 27696 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a35eaf2a50e44728b18c5e9e914ca8d1)
I20260807 15:20:24.364434 27693 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } }
I20260807 15:20:24.364529 27696 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } }
I20260807 15:20:24.365530 27693 leader_election.cc:288] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795), d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252:39519)
I20260807 15:20:24.365592 27696 leader_election.cc:288] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795), 89ed8a733e7b4a3e9fbff646a5eb25ab (127.15.242.253:40251)
I20260807 15:20:24.366815 27702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.365846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56010)
0807 15:20:24.366466 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.366663 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":74,"threads_started":1}
I20260807 15:20:24.367043 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.365863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56020)
0807 15:20:24.366405 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.366950 (+ 545us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":90,"threads_started":1}
W20260807 15:20:24.367074 26863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
W20260807 15:20:24.367230 26584 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:24.368275 27702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.368053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56026)
0807 15:20:24.368157 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.368213 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 15:20:24.368444 26863 leader_election.cc:334] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795): Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:24.368893 27697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.368636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56028)
0807 15:20:24.368754 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.368829 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 15:20:24.369019 26584 leader_election.cc:334] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795): Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:24.370890 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.366590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37116 (local address 127.15.242.253:40251)
0807 15:20:24.366816 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:24.366822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:24.366838 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:20:24.366891 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:24.366894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:24.366934 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:24.367330 (+ 396us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:24.367442 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:24.368214 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:24.369816 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:24.370322 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:24.370461 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:24.370513 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:24.370694 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 15:20:24.370775 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
I20260807 15:20:24.370929 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.366238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:40251 (local address 127.0.0.1:37116)
0807 15:20:24.366446 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.366464 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:24.366579 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:24.367064 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:24.367067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:24.367087 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:24.367208 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:24.367215 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:24.368388 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:24.368393 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:24.369654 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:24.369699 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:24.370455 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:24.370459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:24.370551 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:24.370574 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 15:20:24.370676 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 15:20:24.370805 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":25,"thread_start_us":71,"threads_started":1}
I20260807 15:20:24.371591 26615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d4f83163231b4693b63a4e9b2f738de9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" is_pre_election: true
I20260807 15:20:24.371673 27708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.366505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40958 (local address 127.15.242.252:39519)
0807 15:20:24.367080 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:24.367084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:24.367094 (+ 10us) server_negotiation.cc:407] Connection header received
0807 15:20:24.367577 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:24.367580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:24.367623 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:24.367706 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:24.368017 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:24.369240 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:24.370362 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:24.370844 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:24.371063 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:24.371114 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:24.371480 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 15:20:24.371552 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":513,"thread_start_us":83,"threads_started":1}
I20260807 15:20:24.371707 27705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.366396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39519 (local address 127.0.0.1:40958)
0807 15:20:24.366814 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.366829 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:24.366906 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:24.367805 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:24.367808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:24.367826 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:24.367902 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:24.367907 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:24.369359 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:24.369365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:24.370237 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:24.370247 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:24.371261 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:24.371267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:24.371349 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:24.371367 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 15:20:24.371460 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 15:20:24.371529 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":21,"thread_start_us":68,"threads_started":1}
I20260807 15:20:24.371847 26615 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4f83163231b4693b63a4e9b2f738de9 in term 1.
I20260807 15:20:24.372109 26896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d4f83163231b4693b63a4e9b2f738de9" is_pre_election: true
I20260807 15:20:24.372206 26863 leader_election.cc:302] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89ed8a733e7b4a3e9fbff646a5eb25ab, d4f83163231b4693b63a4e9b2f738de9; no voters: a35eaf2a50e44728b18c5e9e914ca8d1
I20260807 15:20:24.372314 26896 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ed8a733e7b4a3e9fbff646a5eb25ab in term 1.
I20260807 15:20:24.372457 27696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:20:24.372524 27696 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a35eaf2a50e44728b18c5e9e914ca8d1)
I20260807 15:20:24.372561 27696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:20:24.372653 26584 leader_election.cc:302] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89ed8a733e7b4a3e9fbff646a5eb25ab, d4f83163231b4693b63a4e9b2f738de9; no voters: a35eaf2a50e44728b18c5e9e914ca8d1
I20260807 15:20:24.372874 27693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 15:20:24.372923 27693 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader a35eaf2a50e44728b18c5e9e914ca8d1)
I20260807 15:20:24.372961 27693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:20:24.373694 27696 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } }
I20260807 15:20:24.373910 27693 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } }
I20260807 15:20:24.374042 27696 leader_election.cc:288] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [CANDIDATE]: Term 2 election: Requested vote from peers a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795), 89ed8a733e7b4a3e9fbff646a5eb25ab (127.15.242.253:40251)
I20260807 15:20:24.374253 27693 leader_election.cc:288] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 2 election: Requested vote from peers a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795), d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252:39519)
I20260807 15:20:24.374483 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.374143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56042)
0807 15:20:24.374368 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.374421 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
I20260807 15:20:24.374648 27705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.374371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56054)
0807 15:20:24.374467 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.374520 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 15:20:24.374722 26615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d4f83163231b4693b63a4e9b2f738de9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab"
I20260807 15:20:24.374883 26615 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d4f83163231b4693b63a4e9b2f738de9 in current term 2: Already voted for candidate 89ed8a733e7b4a3e9fbff646a5eb25ab in this term.
I20260807 15:20:24.375105 26896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d4f83163231b4693b63a4e9b2f738de9"
I20260807 15:20:24.375175 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.374977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56060)
0807 15:20:24.375068 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.375117 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 15:20:24.375273 26896 raft_consensus.cc:2379] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ed8a733e7b4a3e9fbff646a5eb25ab in current term 2: Already voted for candidate d4f83163231b4693b63a4e9b2f738de9 in this term.
W20260807 15:20:24.375311 26863 leader_election.cc:334] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795): Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:24.375727 26863 leader_election.cc:302] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4f83163231b4693b63a4e9b2f738de9; no voters: 89ed8a733e7b4a3e9fbff646a5eb25ab, a35eaf2a50e44728b18c5e9e914ca8d1
I20260807 15:20:24.375897 27696 raft_consensus.cc:2726] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:20:24.376108 27705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.375863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56076)
0807 15:20:24.376000 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.376050 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 15:20:24.376214 26584 leader_election.cc:334] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795): Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:24.376308 26584 leader_election.cc:302] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ed8a733e7b4a3e9fbff646a5eb25ab; no voters: a35eaf2a50e44728b18c5e9e914ca8d1, d4f83163231b4693b63a4e9b2f738de9
I20260807 15:20:24.376436 27693 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 15:20:24.850766 27714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.850281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:55503)
0807 15:20:24.850586 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.850662 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":108,"threads_started":1}
I20260807 15:20:24.853574 27715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.853061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:44125)
0807 15:20:24.853377 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.853454 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":94,"threads_started":1}
I20260807 15:20:24.853950 27717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:24.853160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.195:51853)
0807 15:20:24.853797 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:24.853872 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":95,"threads_started":1}
I20260807 15:20:25.852262 27722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:25.851783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:40693)
0807 15:20:25.852073 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:25.852140 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":90,"threads_started":1}
I20260807 15:20:25.855352 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:25.854398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:58721)
0807 15:20:25.855158 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:25.855244 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":105,"threads_started":1}
I20260807 15:20:25.855808 27726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:25.855344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.195:41005)
0807 15:20:25.855639 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:25.855709 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":66,"threads_started":1}
I20260807 15:20:25.975461 27727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:25.975656 27727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } }
I20260807 15:20:25.976177 27727 leader_election.cc:288] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795), d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252:39519)
I20260807 15:20:25.977068 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:25.976476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56290)
0807 15:20:25.976810 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:25.976913 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":118,"threads_started":1}
I20260807 15:20:25.977380 26896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d4f83163231b4693b63a4e9b2f738de9" is_pre_election: true
I20260807 15:20:25.977545 26896 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ed8a733e7b4a3e9fbff646a5eb25ab in term 2.
I20260807 15:20:25.978001 26584 leader_election.cc:302] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ed8a733e7b4a3e9fbff646a5eb25ab, d4f83163231b4693b63a4e9b2f738de9; no voters:
I20260807 15:20:25.978202 27727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 15:20:25.978291 27727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:25.978355 27727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:20:25.978669 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:25.978403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56300)
0807 15:20:25.978543 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:25.978604 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 15:20:25.978888 26584 leader_election.cc:334] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795): Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:25.979668 27727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } }
I20260807 15:20:25.980130 27727 leader_election.cc:288] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 3 election: Requested vote from peers a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795), d4f83163231b4693b63a4e9b2f738de9 (127.15.242.252:39519)
I20260807 15:20:25.980546 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:25.980276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56312)
0807 15:20:25.980400 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:25.980464 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 15:20:25.980865 26896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d4f83163231b4693b63a4e9b2f738de9"
I20260807 15:20:25.981020 26896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:20:25.982092 26896 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ed8a733e7b4a3e9fbff646a5eb25ab in term 3.
I20260807 15:20:25.982493 26584 leader_election.cc:302] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ed8a733e7b4a3e9fbff646a5eb25ab, d4f83163231b4693b63a4e9b2f738de9; no voters:
I20260807 15:20:25.982685 27727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:20:25.982894 27727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [term 3 LEADER]: Becoming Leader. State: Replica: 89ed8a733e7b4a3e9fbff646a5eb25ab, State: Running, Role: LEADER
I20260807 15:20:25.983158 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:25.982865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56322)
0807 15:20:25.983032 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:25.983089 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260807 15:20:25.983289 27727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } }
W20260807 15:20:25.983297 26584 leader_election.cc:334] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795): Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
I20260807 15:20:25.984973 27731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89ed8a733e7b4a3e9fbff646a5eb25ab. Latest consensus state: current_term: 3 leader_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:25.985150 27731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:25.985549 27733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:25.987920 27733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:25.988320 27733 catalog_manager.cc:1259] Loaded cluster ID: 6be3e683a328480793754c8f5653ef8a
I20260807 15:20:25.988369 27733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:25.989140 27733 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:25.989563 27733 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Loaded TSK: 0
I20260807 15:20:25.990406 27733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:20:26.067039 26602 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:20:26.070468 26602 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:26.073876 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.073623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56352)
0807 15:20:26.073755 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.073810 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 15:20:26.073894 26896 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [term 3 FOLLOWER]: Refusing update from remote peer 89ed8a733e7b4a3e9fbff646a5eb25ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 15:20:26.074375 27731 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 15:20:26.074820 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.074484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:56368)
0807 15:20:26.074638 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.074749 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260807 15:20:26.074941 26584 consensus_peers.cc:487] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab -> Peer a35eaf2a50e44728b18c5e9e914ca8d1 (127.15.242.254:44795): Couldn't send request to peer a35eaf2a50e44728b18c5e9e914ca8d1. Status: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 15:20:26.075985 27736 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89ed8a733e7b4a3e9fbff646a5eb25ab. Latest consensus state: current_term: 3 leader_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:26.076129 27736 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:20:26.077688 27731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:26.077843 27731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:26.078801 27736 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a35eaf2a50e44728b18c5e9e914ca8d1" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44795 } } peers { permanent_uuid: "89ed8a733e7b4a3e9fbff646a5eb25ab" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 40251 } attrs { promote: false } } peers { permanent_uuid: "d4f83163231b4693b63a4e9b2f738de9" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39519 } attrs { promote: false } } }
I20260807 15:20:26.079375 27736 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f83163231b4693b63a4e9b2f738de9 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:20:26.090308 27728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.085486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:43793 (local address 127.0.0.1:60010)
0807 15:20:26.085607 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.085624 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:26.085723 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:26.086302 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:26.086304 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:26.086319 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:26.086424 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:26.086432 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.087495 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.087498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:26.088835 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:26.088847 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.089776 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.089779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:26.089950 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:26.089979 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 15:20:26.090049 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 15:20:26.090138 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":80}
I20260807 15:20:26.091009 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.085778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60010 (local address 127.15.242.193:43793)
0807 15:20:26.086056 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:26.086061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:26.086077 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:20:26.086140 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:26.086143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:26.086193 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:26.086298 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:26.086568 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.087360 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.088995 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.089622 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.090708 (+ 1086us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:26.090750 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:26.090784 (+ 34us) server_negotiation.cc:299] Negotiation successful
0807 15:20:26.090877 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":97,"threads_started":1}
I20260807 15:20:26.091121 27748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.086027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40862 (local address 127.15.242.195:39175)
0807 15:20:26.086655 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:26.086660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:26.086676 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:20:26.086739 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:26.086742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:26.086792 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:26.086910 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:26.087393 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.088200 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.089657 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.090365 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.090506 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:26.090570 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:26.090884 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 15:20:26.090965 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":112,"threads_started":1}
I20260807 15:20:26.091116 27743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.085797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:39175 (local address 127.0.0.1:40862)
0807 15:20:26.086066 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.086080 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:26.086166 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:26.087068 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:26.087071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:26.087091 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:26.087228 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:26.087236 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.088315 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.088322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:26.089479 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:26.089511 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.090636 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.090642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:26.090741 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:26.090766 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 15:20:26.090849 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 15:20:26.090957 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":142,"threads_started":1}
I20260807 15:20:26.091851 27486 tablet_service.cc:1467] Processing CreateTablet for tablet 91ecaa7d3839412ebb7c6632cf38d849 (DEFAULT_TABLE table=test-table [id=ff538058cbf4429aa8c9af06328280d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:26.091923 27056 tablet_service.cc:1467] Processing CreateTablet for tablet 91ecaa7d3839412ebb7c6632cf38d849 (DEFAULT_TABLE table=test-table [id=ff538058cbf4429aa8c9af06328280d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:26.092170 27486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ecaa7d3839412ebb7c6632cf38d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:26.092170 27056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ecaa7d3839412ebb7c6632cf38d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:26.092201 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.086601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:38723 (local address 127.0.0.1:48770)
0807 15:20:26.087119 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.087132 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:26.087228 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:26.087782 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:26.087785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:26.087807 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:26.087928 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:26.087934 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.089084 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.089088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:26.090542 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:26.090554 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.091717 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.091721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:26.091820 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:26.091843 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 15:20:26.091947 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 15:20:26.092056 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":33,"thread_start_us":89,"threads_started":1}
I20260807 15:20:26.092201 27750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.086731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48770 (local address 127.15.242.194:38723)
0807 15:20:26.087537 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:26.087542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:26.087554 (+ 12us) server_negotiation.cc:407] Connection header received
0807 15:20:26.087606 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:26.087609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:26.087654 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:26.087745 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:26.088111 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.088925 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.090709 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.091552 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.091734 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:26.091790 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:26.091968 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 15:20:26.092056 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":91,"threads_started":1}
I20260807 15:20:26.094885 27754 tablet_bootstrap.cc:492] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90: Bootstrap starting.
I20260807 15:20:26.094906 27751 tablet_bootstrap.cc:492] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: Bootstrap starting.
I20260807 15:20:26.095019 27277 tablet_service.cc:1467] Processing CreateTablet for tablet 91ecaa7d3839412ebb7c6632cf38d849 (DEFAULT_TABLE table=test-table [id=ff538058cbf4429aa8c9af06328280d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:26.095326 27277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ecaa7d3839412ebb7c6632cf38d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:26.096230 27751 tablet_bootstrap.cc:654] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:26.096230 27754 tablet_bootstrap.cc:654] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:26.097548 27751 tablet_bootstrap.cc:492] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: No bootstrap required, opened a new log
I20260807 15:20:26.097649 27751 ts_tablet_manager.cc:1397] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.002s
I20260807 15:20:26.098039 27757 tablet_bootstrap.cc:492] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: Bootstrap starting.
I20260807 15:20:26.098155 27754 tablet_bootstrap.cc:492] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90: No bootstrap required, opened a new log
I20260807 15:20:26.098150 27751 raft_consensus.cc:348] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.098245 27754 ts_tablet_manager.cc:1397] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:26.098277 27751 raft_consensus.cc:374] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:26.098338 27751 raft_consensus.cc:729] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15fbb376d0074f4ba98944cf7fa3f5b4, State: Initialized, Role: FOLLOWER
I20260807 15:20:26.098474 27751 consensus_queue.cc:260] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.098874 27751 ts_tablet_manager.cc:1428] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 15:20:26.098827 27754 raft_consensus.cc:348] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.099083 27757 tablet_bootstrap.cc:654] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:26.099381 27754 raft_consensus.cc:374] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:26.099450 27754 raft_consensus.cc:729] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d264750702440a4b29f210b803c7c90, State: Initialized, Role: FOLLOWER
I20260807 15:20:26.099606 27754 consensus_queue.cc:260] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.099856 27726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.099385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.195:55807)
0807 15:20:26.099695 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.099785 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226}
I20260807 15:20:26.100028 27754 ts_tablet_manager.cc:1428] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 15:20:26.100822 27722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.100445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:57105)
0807 15:20:26.100654 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.100720 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260807 15:20:26.102381 27722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.102145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:52197)
0807 15:20:26.102248 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.102309 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 15:20:26.102655 27757 tablet_bootstrap.cc:492] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: No bootstrap required, opened a new log
I20260807 15:20:26.102753 27757 ts_tablet_manager.cc:1397] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260807 15:20:26.102804 27164 heartbeater.cc:503] Master 127.15.242.253:40251 was elected leader, sending a full tablet report...
I20260807 15:20:26.103211 27757 raft_consensus.cc:348] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.103355 27757 raft_consensus.cc:374] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:26.103400 27757 raft_consensus.cc:729] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1820be41aaf54e17b2636f9133f451a8, State: Initialized, Role: FOLLOWER
I20260807 15:20:26.103539 27757 consensus_queue.cc:260] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.104003 27757 ts_tablet_manager.cc:1428] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:26.104810 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.104505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:55653)
0807 15:20:26.104626 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.104707 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 15:20:26.105511 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.105282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:52663)
0807 15:20:26.105408 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.105457 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 15:20:26.187265 27587 tablet.cc:2369] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:20:26.206140 27385 tablet.cc:2369] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:20:26.219583 27167 tablet.cc:2369] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:20:26.479055 27763 raft_consensus.cc:482] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:26.479300 27763 raft_consensus.cc:504] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.479907 27763 leader_election.cc:288] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793), 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175)
I20260807 15:20:26.480538 27090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ecaa7d3839412ebb7c6632cf38d849" candidate_uuid: "1820be41aaf54e17b2636f9133f451a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d264750702440a4b29f210b803c7c90" is_pre_election: true
I20260807 15:20:26.480537 27518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ecaa7d3839412ebb7c6632cf38d849" candidate_uuid: "1820be41aaf54e17b2636f9133f451a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" is_pre_election: true
I20260807 15:20:26.480706 27518 raft_consensus.cc:2454] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1820be41aaf54e17b2636f9133f451a8 in term 0.
I20260807 15:20:26.480827 27090 raft_consensus.cc:2454] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1820be41aaf54e17b2636f9133f451a8 in term 0.
I20260807 15:20:26.481172 27207 leader_election.cc:302] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15fbb376d0074f4ba98944cf7fa3f5b4, 1820be41aaf54e17b2636f9133f451a8; no voters:
I20260807 15:20:26.481446 27763 raft_consensus.cc:2781] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:26.481524 27763 raft_consensus.cc:482] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:26.481635 27763 raft_consensus.cc:3037] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:26.482720 27763 raft_consensus.cc:504] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.483070 27763 leader_election.cc:288] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [CANDIDATE]: Term 1 election: Requested vote from peers 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793), 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175)
I20260807 15:20:26.483516 27518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ecaa7d3839412ebb7c6632cf38d849" candidate_uuid: "1820be41aaf54e17b2636f9133f451a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4"
I20260807 15:20:26.483527 27090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ecaa7d3839412ebb7c6632cf38d849" candidate_uuid: "1820be41aaf54e17b2636f9133f451a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d264750702440a4b29f210b803c7c90"
I20260807 15:20:26.483666 27518 raft_consensus.cc:3037] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:26.483666 27090 raft_consensus.cc:3037] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:26.484998 27518 raft_consensus.cc:2454] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1820be41aaf54e17b2636f9133f451a8 in term 1.
I20260807 15:20:26.485128 27090 raft_consensus.cc:2454] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1820be41aaf54e17b2636f9133f451a8 in term 1.
I20260807 15:20:26.485391 27207 leader_election.cc:302] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15fbb376d0074f4ba98944cf7fa3f5b4, 1820be41aaf54e17b2636f9133f451a8; no voters:
I20260807 15:20:26.485585 27763 raft_consensus.cc:2781] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:26.485849 27763 raft_consensus.cc:686] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 1 LEADER]: Becoming Leader. State: Replica: 1820be41aaf54e17b2636f9133f451a8, State: Running, Role: LEADER
I20260807 15:20:26.486040 27763 consensus_queue.cc:237] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } }
I20260807 15:20:26.486220 27383 heartbeater.cc:503] Master 127.15.242.253:40251 was elected leader, sending a full tablet report...
I20260807 15:20:26.486660 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.486391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:43573)
0807 15:20:26.486525 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.486589 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 15:20:26.488270 26604 catalog_manager.cc:5495] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1820be41aaf54e17b2636f9133f451a8 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "1820be41aaf54e17b2636f9133f451a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1820be41aaf54e17b2636f9133f451a8" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 38723 } health_report { overall_health: HEALTHY } } }
I20260807 15:20:26.527367 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.527035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:44938)
0807 15:20:26.527208 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.527278 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 15:20:26.528276 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.528017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.0.0.1:44952)
0807 15:20:26.528155 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.528216 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 15:20:26.548832 27750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.545903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50722 (local address 127.15.242.194:38723)
0807 15:20:26.546044 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:26.546048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:26.546061 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:20:26.546111 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:26.546112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:26.546156 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:26.546234 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:26.546469 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.546972 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.547783 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:26.547985 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:26.548059 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:26.548353 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:26.548421 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:26.548476 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:26.548620 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 15:20:26.548668 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:20:26.551182 27090 raft_consensus.cc:1261] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 1 FOLLOWER]: Refusing update from remote peer 1820be41aaf54e17b2636f9133f451a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:26.551234 27518 raft_consensus.cc:1261] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 1 FOLLOWER]: Refusing update from remote peer 1820be41aaf54e17b2636f9133f451a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:26.551679 27763 consensus_queue.cc:1035] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d264750702440a4b29f210b803c7c90" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 43793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:26.551937 27764 consensus_queue.cc:1035] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15fbb376d0074f4ba98944cf7fa3f5b4" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 39175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:26.553349 27722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.553086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:51639)
0807 15:20:26.553238 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.553288 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 15:20:26.554302 27726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.553917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.195:51355)
0807 15:20:26.554158 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.554224 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
I20260807 15:20:26.555722 27586 heartbeater.cc:503] Master 127.15.242.253:40251 was elected leader, sending a full tablet report...
I20260807 15:20:26.556465 27768 mvcc.cc:205] Tried to move back new op lower bound from 7315931244749189120 to 7315931244488515584. Current Snapshot: MvccSnapshot[applied={T|T < 7315931244749189120}]
I20260807 15:20:26.557013 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.556695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:46233)
0807 15:20:26.556867 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.556929 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260807 15:20:26.559023 27774 mvcc.cc:205] Tried to move back new op lower bound from 7315931244749189120 to 7315931244488515584. Current Snapshot: MvccSnapshot[applied={T|T < 7315931244749189120 or (T in {7315931244749189120})}]
I20260807 15:20:26.559345 27722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.558821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.193:38593)
0807 15:20:26.559191 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.559247 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286}
I20260807 15:20:26.559911 27726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.559627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.195:59099)
0807 15:20:26.559768 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.559832 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 15:20:26.562529 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.562255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44795 (local address 127.15.242.194:45521)
0807 15:20:26.562390 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.562452 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:44795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 15:20:26.565012 26602 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:26.565168 26602 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:26.568909 26602 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 89ed8a733e7b4a3e9fbff646a5eb25ab: Sending DeleteTablet for 3 replicas of tablet 91ecaa7d3839412ebb7c6632cf38d849
I20260807 15:20:26.569690 27486 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ecaa7d3839412ebb7c6632cf38d849 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:26 UTC) from {username='oryx', principal='oryx/127.15.242.253@KRBTEST.COM'} at 127.0.0.1:40862
I20260807 15:20:26.569736 27277 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ecaa7d3839412ebb7c6632cf38d849 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:26 UTC) from {username='oryx', principal='oryx/127.15.242.253@KRBTEST.COM'} at 127.0.0.1:48770
I20260807 15:20:26.569913 27056 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ecaa7d3839412ebb7c6632cf38d849 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:26 UTC) from {username='oryx', principal='oryx/127.15.242.253@KRBTEST.COM'} at 127.0.0.1:60010
I20260807 15:20:26.570152 27787 tablet_replica.cc:330] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: stopping tablet replica
I20260807 15:20:26.570292 27788 tablet_replica.cc:330] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90: stopping tablet replica
I20260807 15:20:26.570303 27787 raft_consensus.cc:2229] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:20:26.570437 27788 raft_consensus.cc:2229] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:26.570530 27787 raft_consensus.cc:2258] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:26.570590 27788 raft_consensus.cc:2258] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:26.570772 27786 tablet_replica.cc:330] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: stopping tablet replica
I20260807 15:20:26.570907 27786 raft_consensus.cc:2229] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:26.571065 27786 raft_consensus.cc:2258] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:26.571134 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 26822
I20260807 15:20:26.571560 27788 ts_tablet_manager.cc:1905] T 91ecaa7d3839412ebb7c6632cf38d849 P 6d264750702440a4b29f210b803c7c90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:26.574390 27786 ts_tablet_manager.cc:1905] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:26.578106 27786 ts_tablet_manager.cc:1918] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:26.578219 27786 log.cc:1196] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/91ecaa7d3839412ebb7c6632cf38d849
I20260807 15:20:26.578557 27786 ts_tablet_manager.cc:1939] T 91ecaa7d3839412ebb7c6632cf38d849 P 15fbb376d0074f4ba98944cf7fa3f5b4: Deleting consensus metadata
I20260807 15:20:26.580657 26582 catalog_manager.cc:4841] TS 15fbb376d0074f4ba98944cf7fa3f5b4 (127.15.242.195:39175): tablet 91ecaa7d3839412ebb7c6632cf38d849 (table test-table [id=ff538058cbf4429aa8c9af06328280d1]) successfully deleted
I20260807 15:20:26.581167 27787 ts_tablet_manager.cc:1905] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:26.583348 27787 ts_tablet_manager.cc:1918] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:26.583462 27787 log.cc:1196] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/91ecaa7d3839412ebb7c6632cf38d849
I20260807 15:20:26.583770 27787 ts_tablet_manager.cc:1939] T 91ecaa7d3839412ebb7c6632cf38d849 P 1820be41aaf54e17b2636f9133f451a8: Deleting consensus metadata
I20260807 15:20:26.584547 26582 catalog_manager.cc:4841] TS 1820be41aaf54e17b2636f9133f451a8 (127.15.242.194:38723): tablet 91ecaa7d3839412ebb7c6632cf38d849 (table test-table [id=ff538058cbf4429aa8c9af06328280d1]) successfully deleted
I20260807 15:20:26.587836 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 27175
I20260807 15:20:26.590451 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:26.587939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:43793 (local address 127.0.0.1:37342)
0807 15:20:26.590255 (+ 2316us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:26.590329 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:43793: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2181}
W20260807 15:20:26.592013 26583 catalog_manager.cc:4584] TS 6d264750702440a4b29f210b803c7c90 (127.15.242.193:43793): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 91ecaa7d3839412ebb7c6632cf38d849: Network error: Client connection negotiation failed: client connection to 127.15.242.193:43793: connect: Connection refused (error 111)
I20260807 15:20:26.606716 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 27392
I20260807 15:20:26.623440 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 26402
I20260807 15:20:26.636224 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 26564
2026-08-07T15:20:26Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (8468 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:26 dist-test-slave-g170 krb5kdc[27793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:26 dist-test-slave-g170 krb5kdc[27793](info): set up 2 sockets
Aug 07 15:20:26 dist-test-slave-g170 krb5kdc[27793](info): commencing operation
krb5kdc: starting...
W20260807 15:20:27.911129 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:28 dist-test-slave-g170 krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.254.keytab.
Entry for principal oryx/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.254.keytab.
I20260807 15:20:28.048199 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:44647
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.254.keytab
--principal=oryx/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:45749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:44647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:28.166266 27813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:28.166589 27813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:28.166662 27813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:28.170941 27813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:28.171046 27813 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 15:20:28.171077 27813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:28.171123 27813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:28.171160 27813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:28.171200 27813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:28.176601 27813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:44647
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.254.keytab
--principal=oryx/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:44647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:28.177757 27813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:28.178822 27813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:28.188030 27819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:28.188066 27822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:28.188185 27813 server_base.cc:1034] running on GCE node
W20260807 15:20:28.188081 27820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:28.188911 27813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:28.190016 27813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:28.191195 27813 hybrid_clock.cc:648] HybridClock initialized: now 1786116028191173 us; error 36 us; skew 500 ppm
Aug 07 15:20:28 dist-test-slave-g170 krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:28.194211 27813 init.cc:377] Logged in from keytab as oryx/127.15.242.254@KRBTEST.COM (short username oryx)
I20260807 15:20:28.195109 27813 webserver.cc:460] Webserver started at http://127.15.242.254:39523/ using document root <none> and password file <none>
I20260807 15:20:28.195724 27813 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:28.195833 27813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:28.196092 27813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:28.198262 27813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "d9d3ecf0ce224018b7028ca12258939f"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "177bd7bcce5a6f909c4d21a7ad5ab37a"
server_key_iv: "b87364157be398cc7e252c7d2615208d"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.198884 27813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "d9d3ecf0ce224018b7028ca12258939f"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "177bd7bcce5a6f909c4d21a7ad5ab37a"
server_key_iv: "b87364157be398cc7e252c7d2615208d"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.202970 27813 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:28.205653 27836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:28.207013 27813 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:20:28.207165 27813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "d9d3ecf0ce224018b7028ca12258939f"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "177bd7bcce5a6f909c4d21a7ad5ab37a"
server_key_iv: "b87364157be398cc7e252c7d2615208d"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.207283 27813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:28.225426 27813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:28.228623 27813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:28.228861 27813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:28.237390 27813 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:44647
I20260807 15:20:28.237452 27926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:44647 every 8 connection(s)
I20260807 15:20:28.238409 27813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:28.241580 27927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:28.246245 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 27813
I20260807 15:20:28.246392 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:28.246685 16331 external_mini_cluster.cc:1428] Setting key 3d51fd96e47045bab6670b8d87709950
I20260807 15:20:28.248301 27927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: Bootstrap starting.
I20260807 15:20:28.250875 27927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:28.251744 27927 log.cc:824] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:28.254004 27927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: No bootstrap required, opened a new log
Aug 07 15:20:28 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:28.259188 27927 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9d3ecf0ce224018b7028ca12258939f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44647 } }
I20260807 15:20:28.259495 27927 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:28.259589 27927 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9d3ecf0ce224018b7028ca12258939f, State: Initialized, Role: FOLLOWER
I20260807 15:20:28.260185 27927 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9d3ecf0ce224018b7028ca12258939f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44647 } }
I20260807 15:20:28.260371 27927 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:28.260452 27927 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:28.260571 27927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:28.261950 27927 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9d3ecf0ce224018b7028ca12258939f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44647 } }
I20260807 15:20:28.262377 27927 leader_election.cc:302] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9d3ecf0ce224018b7028ca12258939f; no voters:
I20260807 15:20:28.262753 27927 leader_election.cc:288] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:28.262770 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.248229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50102 (local address 127.15.242.254:44647)
0807 15:20:28.248719 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:28.248734 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:28.248821 (+ 87us) server_negotiation.cc:407] Connection header received
0807 15:20:28.249459 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:28.249475 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:28.249809 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:28.250149 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:28.250995 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.252094 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.253010 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.253481 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.253663 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.256543 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:28.256552 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:28.256583 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:28.256624 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:28.259022 (+ 2398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.259473 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.259480 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.259498 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.259685 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.259984 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.259988 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.259990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.260604 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:28.260878 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:28.261187 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 15:20:28.261524 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":161,"threads_started":1}
I20260807 15:20:28.262861 27938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:28.263088 27938 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [term 1 LEADER]: Becoming Leader. State: Replica: d9d3ecf0ce224018b7028ca12258939f, State: Running, Role: LEADER
I20260807 15:20:28.263441 27938 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9d3ecf0ce224018b7028ca12258939f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44647 } }
I20260807 15:20:28.264242 27927 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:28.265210 27939 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9d3ecf0ce224018b7028ca12258939f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9d3ecf0ce224018b7028ca12258939f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44647 } } }
I20260807 15:20:28.265352 27939 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:28.265370 27942 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9d3ecf0ce224018b7028ca12258939f. Latest consensus state: current_term: 1 leader_uuid: "d9d3ecf0ce224018b7028ca12258939f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9d3ecf0ce224018b7028ca12258939f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44647 } } }
I20260807 15:20:28.265432 27942 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:28.265774 27951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:28.269163 27951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:28.276394 27951 catalog_manager.cc:1347] Generated new cluster ID: 3ae95ea1dd3e4571a5c3fad28f5cb9b3
I20260807 15:20:28.276597 27951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:28.285272 27951 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:28.286428 27951 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:28.303678 27951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: Generated new TSK 0
I20260807 15:20:28.304499 27951 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab.
Entry for principal oryx/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab.
I20260807 15:20:28.336305 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44647
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab
--principal=oryx/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:45749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:28.452515 27968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:28.452852 27968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:28.452950 27968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:28.457466 27968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:28.457572 27968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:28.457652 27968 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:20:28.457818 27968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:28.463564 27968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab
--principal=oryx/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:44647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:28.464807 27968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:28.465951 27968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:28.475682 27975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:28.475759 27979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:28.475677 27977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:28.475924 27968 server_base.cc:1034] running on GCE node
I20260807 15:20:28.476377 27968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:28.477073 27968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:28.478241 27968 hybrid_clock.cc:648] HybridClock initialized: now 1786116028478226 us; error 29 us; skew 500 ppm
Aug 07 15:20:28 dist-test-slave-g170 krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:28.481248 27968 init.cc:377] Logged in from keytab as oryx/127.15.242.193@KRBTEST.COM (short username oryx)
I20260807 15:20:28.482115 27968 webserver.cc:460] Webserver started at http://127.15.242.193:41841/ using document root <none> and password file <none>
I20260807 15:20:28.482678 27968 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:28.482743 27968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:28.482993 27968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:28.485098 27968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "3d24c694ec974700878d76d1cac31258"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "cf8feadc45fe6c8e6685f3cff1632bc1"
server_key_iv: "a7a837800d0edd93e9ac5b688ebc90e7"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.485666 27968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "3d24c694ec974700878d76d1cac31258"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "cf8feadc45fe6c8e6685f3cff1632bc1"
server_key_iv: "a7a837800d0edd93e9ac5b688ebc90e7"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.489451 27968 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:20:28.491878 27992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:28.493192 27968 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 15:20:28.493294 27968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "3d24c694ec974700878d76d1cac31258"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "cf8feadc45fe6c8e6685f3cff1632bc1"
server_key_iv: "a7a837800d0edd93e9ac5b688ebc90e7"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.493428 27968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:28.511852 27968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:28.515023 27968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:28.515224 27968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:28.516680 27968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:28.516731 27968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:28.516829 27968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:28.516872 27968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:20:28 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:28.528398 27968 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:38287
I20260807 15:20:28.528517 28186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:38287 every 8 connection(s)
I20260807 15:20:28.529552 27968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:28.531946 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.517738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:39487 (local address 127.15.242.254:44647)
0807 15:20:28.517870 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:28.517874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:28.518905 (+ 1031us) server_negotiation.cc:407] Connection header received
0807 15:20:28.520455 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:28.520459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:28.520524 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:28.520684 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:28.522324 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.522916 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.524301 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.524651 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.524766 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.527982 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:28.527986 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:28.527989 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:28.528045 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:28.529751 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.530433 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.530437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.530439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.530563 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.530927 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.530929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.530931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.531122 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:28.531212 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:28.531703 (+ 491us) server_negotiation.cc:299] Negotiation successful
0807 15:20:28.531823 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:20:28.532739 28008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.518141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44647 (local address 127.15.242.193:39487)
0807 15:20:28.518703 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:28.518755 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:28.520150 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:28.520909 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:28.520918 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:28.521408 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:28.522149 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:28.522192 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.523055 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.523058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:28.524165 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:28.524176 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.524880 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.524886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:28.525048 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.526234 (+ 1186us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:28.526253 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:28.527805 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:28.529892 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:28.529898 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:28.529913 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:28.530302 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:28.530670 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:28.530673 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:28.530675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:28.530817 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:28.531223 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:28.531228 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:28.531476 (+ 248us) client_negotiation.cc:769] Sending connection context
0807 15:20:28.531634 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 15:20:28.531886 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":180,"threads_started":1}
I20260807 15:20:28.533974 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 27968
I20260807 15:20:28.534113 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:28.534250 28187 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44647
I20260807 15:20:28.534415 28187 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:28.534525 16331 external_mini_cluster.cc:1428] Setting key e5a5c0f66fd446a44cafd9e5db4901eb
I20260807 15:20:28.534999 28187 heartbeater.cc:511] Master 127.15.242.254:44647 requested a full tablet report, sending...
I20260807 15:20:28.536872 27857 ts_manager.cc:194] Registered new tserver with Master: 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287)
I20260807 15:20:28.538064 27857 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:39487
WARNING: no policy specified for oryx/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:20:28.546447 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.536862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:55551 (local address 127.15.242.254:44647)
0807 15:20:28.537009 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:28.537015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:28.539030 (+ 2015us) server_negotiation.cc:407] Connection header received
0807 15:20:28.539186 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:28.539192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:28.539248 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:28.539305 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:28.540031 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.540558 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.541491 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.541723 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.541834 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.543228 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:28.543231 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:28.543233 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:28.543255 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:28.544657 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.545192 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.545195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.545196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.545271 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.545595 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.545597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.545598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.545761 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:28.545870 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:28.546199 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 15:20:28.546295 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:20:28.546537 28196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.536778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44647 (local address 127.15.242.193:55551)
0807 15:20:28.538925 (+ 2147us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:28.538944 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:28.539059 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:28.539476 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:28.539482 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:28.539761 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:28.539914 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:28.539921 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.540700 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.540704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:28.541365 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:28.541374 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.541842 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.541846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:28.541936 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.542470 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:28.542491 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:28.543083 (+ 592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:28.544805 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:28.544809 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:28.544813 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:28.545091 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:28.545375 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:28.545380 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:28.545384 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:28.545490 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:28.545904 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:28.545910 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:28.546018 (+ 108us) client_negotiation.cc:769] Sending connection context
0807 15:20:28.546133 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 15:20:28.546274 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2037,"thread_start_us":105,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab.
Entry for principal oryx/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab.
I20260807 15:20:28.567648 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44647
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab
--principal=oryx/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:45749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:28.682010 28199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:28.682289 28199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:28.682364 28199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:28.686579 28199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:28.686690 28199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:28.686765 28199 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:20:28.686848 28199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:28.692101 28199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab
--principal=oryx/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:44647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:28.693177 28199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:28.694185 28199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:28.704006 28209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:28.704006 28206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:28.704053 28212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:28.704269 28199 server_base.cc:1034] running on GCE node
I20260807 15:20:28.704936 28199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:28.705561 28199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:28.706758 28199 hybrid_clock.cc:648] HybridClock initialized: now 1786116028706745 us; error 30 us; skew 500 ppm
Aug 07 15:20:28 dist-test-slave-g170 krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:28.709903 28199 init.cc:377] Logged in from keytab as oryx/127.15.242.194@KRBTEST.COM (short username oryx)
I20260807 15:20:28.710981 28199 webserver.cc:460] Webserver started at http://127.15.242.194:36581/ using document root <none> and password file <none>
I20260807 15:20:28.711638 28199 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:28.711711 28199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:28.711973 28199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:28.714152 28199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "2d2372c93e684800bfa246ba07820c26"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "16bcd0c1bb71572e155b94f15701acdb"
server_key_iv: "3d1e85c8da7ecd5b22a7fa4398b5b7b4"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.714773 28199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "2d2372c93e684800bfa246ba07820c26"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "16bcd0c1bb71572e155b94f15701acdb"
server_key_iv: "3d1e85c8da7ecd5b22a7fa4398b5b7b4"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.718657 28199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:28.721235 28222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:28.722687 28199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:28.722839 28199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "2d2372c93e684800bfa246ba07820c26"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "16bcd0c1bb71572e155b94f15701acdb"
server_key_iv: "3d1e85c8da7ecd5b22a7fa4398b5b7b4"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.722946 28199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:28.738431 28199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:28.741472 28199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:28.741671 28199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:28.743137 28199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:28.743186 28199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:28.743225 28199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:28.743283 28199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:20:28 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:28.754799 28199 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:43779
I20260807 15:20:28.754890 28424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:43779 every 8 connection(s)
I20260807 15:20:28.755837 28199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:28.757998 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.744065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:56491 (local address 127.15.242.254:44647)
0807 15:20:28.744214 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:28.744218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:28.745403 (+ 1185us) server_negotiation.cc:407] Connection header received
0807 15:20:28.746493 (+ 1090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:28.746497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:28.746568 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:28.746662 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:28.748508 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.749429 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.750895 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.751266 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.751387 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.754231 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:28.754235 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:28.754238 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:28.754268 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:28.755894 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.756518 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.756522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.756525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.756621 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.757031 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.757034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.757035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.757232 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:28.757314 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:28.757771 (+ 457us) server_negotiation.cc:299] Negotiation successful
0807 15:20:28.757875 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 15:20:28.758816 28238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.744618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44647 (local address 127.15.242.194:56491)
0807 15:20:28.745249 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:28.745293 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:28.746225 (+ 932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:28.747112 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:28.747124 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:28.747572 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:28.748323 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:28.748344 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.749580 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.749584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:28.750753 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:28.750771 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.751445 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.751449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:28.751636 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.752274 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:28.752291 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:28.754045 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:28.756051 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:28.756057 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:28.756071 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:28.756394 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:28.756736 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:28.756739 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:28.756741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:28.756947 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:28.757330 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:28.757335 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:28.757555 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 15:20:28.757702 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 15:20:28.757960 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":152,"threads_started":1}
I20260807 15:20:28.760154 28425 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44647
I20260807 15:20:28.760308 28425 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:28.760921 28425 heartbeater.cc:511] Master 127.15.242.254:44647 requested a full tablet report, sending...
I20260807 15:20:28.762238 27856 ts_manager.cc:194] Registered new tserver with Master: 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779)
I20260807 15:20:28.763029 27856 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:56491
I20260807 15:20:28.765607 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 28199
I20260807 15:20:28.765755 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:28.766048 16331 external_mini_cluster.cc:1428] Setting key 3c96faeb915b7d043f71bedb7d2b86f1
I20260807 15:20:28.771126 28432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.762651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44647 (local address 127.15.242.194:34897)
0807 15:20:28.763082 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:28.763097 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:28.763241 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:28.763528 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:28.763531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:28.763766 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:28.763881 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:28.763887 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.764842 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.764844 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:28.765606 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:28.765616 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.766138 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.766142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:28.766255 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.766868 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:28.766882 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:28.767298 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:28.769356 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:28.769362 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:28.769367 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:28.769617 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:28.770015 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:28.770021 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:28.770024 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:28.770133 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:28.770715 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:28.770717 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:28.770799 (+ 82us) client_negotiation.cc:769] Sending connection context
0807 15:20:28.770883 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 15:20:28.770994 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":129,"threads_started":1}
I20260807 15:20:28.771386 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.762788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:34897 (local address 127.15.242.254:44647)
0807 15:20:28.762917 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:28.762921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:28.763171 (+ 250us) server_negotiation.cc:407] Connection header received
0807 15:20:28.763353 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:28.763358 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:28.763411 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:28.763489 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:28.764030 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.764625 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.765729 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:28.766020 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:28.766141 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:28.767474 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:28.767478 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:28.767481 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:28.767508 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:28.769222 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.769779 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.769785 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.769790 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.769886 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:28.770261 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:28.770267 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:28.770271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:28.770600 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:28.770722 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:28.770978 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 15:20:28.771115 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for oryx/127.15.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab.
Entry for principal oryx/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab.
I20260807 15:20:28.801064 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44647
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab
--principal=oryx/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:45749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:28.922894 28435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:28.923197 28435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:28.923281 28435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:28.927556 28435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:28.927634 28435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:28.927704 28435 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 15:20:28.927790 28435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:28.933089 28435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab
--principal=oryx/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.242.254:44647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:28.934227 28435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:28.935324 28435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:28.945434 28440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:28.945477 28442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:28.945730 28444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:28.945911 28435 server_base.cc:1034] running on GCE node
I20260807 15:20:28.946374 28435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:28.947070 28435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:28.948268 28435 hybrid_clock.cc:648] HybridClock initialized: now 1786116028948254 us; error 30 us; skew 500 ppm
Aug 07 15:20:28 dist-test-slave-g170 krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:28.951226 28435 init.cc:377] Logged in from keytab as oryx/127.15.242.195@KRBTEST.COM (short username oryx)
I20260807 15:20:28.952188 28435 webserver.cc:460] Webserver started at http://127.15.242.195:42045/ using document root <none> and password file <none>
I20260807 15:20:28.952875 28435 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:28.952975 28435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:28.953227 28435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:28.955372 28435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "d68c7327aaa848cbab9889c0e0626259"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "1e211662a33c6a2399ea388a0815457c"
server_key_iv: "ca0ab9abe3f3602b0eb15bf02adb4361"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.955981 28435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "d68c7327aaa848cbab9889c0e0626259"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "1e211662a33c6a2399ea388a0815457c"
server_key_iv: "ca0ab9abe3f3602b0eb15bf02adb4361"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.960110 28435 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:20:28.962896 28457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:28.964208 28435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:28.964354 28435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "d68c7327aaa848cbab9889c0e0626259"
format_stamp: "Formatted at 2026-08-07 15:20:28 on dist-test-slave-g170"
server_key: "1e211662a33c6a2399ea388a0815457c"
server_key_iv: "ca0ab9abe3f3602b0eb15bf02adb4361"
server_key_version: "encryptionkey@0"
I20260807 15:20:28.964478 28435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:28.990119 28435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:28.993731 28435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:28.993961 28435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:28.995568 28435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:28.995656 28435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:28.995750 28435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:28.995805 28435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:29.007953 28435 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:41023
I20260807 15:20:29.008018 28639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:41023 every 8 connection(s)
I20260807 15:20:29.009131 28435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:29.009871 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 28435
I20260807 15:20:29.010044 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:29.010421 16331 external_mini_cluster.cc:1428] Setting key 340b3c4889164009b3c012a0223f6f56
I20260807 15:20:29.011580 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.996424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:49507 (local address 127.15.242.254:44647)
0807 15:20:28.996589 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:28.996594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:28.997728 (+ 1134us) server_negotiation.cc:407] Connection header received
0807 15:20:28.999133 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:28.999136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:28.999233 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:28.999340 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:29.000869 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.001408 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.002661 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.002890 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.003010 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.006699 (+ 3689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:29.006703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:29.006706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:29.006745 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:29.008580 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.009367 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.009372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.009374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.009522 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.010083 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.010089 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.010094 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.010408 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:29.010538 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.011224 (+ 686us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.011383 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:20:29.012427 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:28.996987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44647 (local address 127.15.242.195:49507)
0807 15:20:28.997542 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:28.997605 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:28.998824 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:28.999680 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:28.999687 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.000048 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:29.000701 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.000724 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.001550 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.001553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.002511 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.002522 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.003073 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.003078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.003298 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.004076 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:29.004102 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:29.006471 (+ 2369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:29.008715 (+ 2244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:29.008721 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:29.008738 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:29.009176 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:29.009682 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:29.009686 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:29.009688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:29.009924 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:29.010539 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:29.010565 (+ 26us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:29.010868 (+ 303us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.011074 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.011462 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":111,"threads_started":1}
I20260807 15:20:29.013765 28640 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44647
I20260807 15:20:29.013922 28640 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:29.014547 28640 heartbeater.cc:511] Master 127.15.242.254:44647 requested a full tablet report, sending...
I20260807 15:20:29.015890 27856 ts_manager.cc:194] Registered new tserver with Master: d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:29.016811 27856 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:49507
I20260807 15:20:29.024261 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.016388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:53039 (local address 127.15.242.254:44647)
0807 15:20:29.016522 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.016527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.016735 (+ 208us) server_negotiation.cc:407] Connection header received
0807 15:20:29.016963 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.016967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.017020 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.017106 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:29.017616 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.018216 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.019276 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.019509 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.019601 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.020854 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:29.020858 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:29.020860 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:29.020893 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:29.022240 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.022771 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.022774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.022776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.022867 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.023245 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.023249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.023251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.023504 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:29.023625 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.023960 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.024095 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:20:29.024302 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.016347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44647 (local address 127.15.242.195:53039)
0807 15:20:29.016647 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.016660 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.016839 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.017124 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.017127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.017344 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:29.017485 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.017494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.018374 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.018378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.019149 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.019160 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.019625 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.019628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.019695 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.020295 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:29.020316 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:29.020648 (+ 332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:29.022358 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:29.022361 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:29.022363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:29.022581 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:29.022991 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:29.022994 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:29.022995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:29.023086 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:29.023642 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:29.023646 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:29.023759 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.023881 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.024042 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":123,"threads_started":1}
I20260807 15:20:29.025569 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116029, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 15:20:29.052456 27935 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:29.045879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50106 (local address 127.15.242.254:44647)
0807 15:20:29.046027 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.046031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.046044 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:20:29.046086 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.046088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.046129 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.046195 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:29.047060 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.047583 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.048448 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.048705 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.048881 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.052330 (+ 3449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50106: BlockingRecv error: recv got EOF from 127.0.0.1:50106 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116029, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:29.062734 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.054028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50112 (local address 127.15.242.254:44647)
0807 15:20:29.054149 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.054153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.054370 (+ 217us) server_negotiation.cc:407] Connection header received
0807 15:20:29.054476 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.054478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.054518 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.054589 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:29.055212 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.055751 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.056569 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.056873 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.056953 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.059391 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:29.059394 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:29.059396 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:29.059421 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:29.060923 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.061402 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.061405 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.061406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.061483 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.061851 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.061854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.061855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.062035 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:29.062149 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.062439 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.062551 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:20:29.066066 27857 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:20:29.069496 27857 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:29.085692 28674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.079342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38287 (local address 127.0.0.1:36956)
0807 15:20:29.080032 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.080085 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.080229 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.081151 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.081158 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.081180 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.081357 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.081367 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.082964 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.082968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.084170 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.084181 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.085295 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.085298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.085390 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.085411 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.085476 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.085532 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":24,"spinlock_wait_cycles":1280,"thread_start_us":82,"threads_started":1}
I20260807 15:20:29.085776 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.079489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36956 (local address 127.15.242.193:38287)
0807 15:20:29.080538 (+ 1049us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.080546 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.080569 (+ 23us) server_negotiation.cc:407] Connection header received
0807 15:20:29.080652 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.080660 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.080971 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.081517 (+ 546us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.081636 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.082828 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.084324 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.085167 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.085323 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.085450 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.085520 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.085615 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":924,"thread_start_us":113,"threads_started":1}
I20260807 15:20:29.086026 28681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.080550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39774 (local address 127.15.242.194:43779)
0807 15:20:29.080978 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.080990 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.081013 (+ 23us) server_negotiation.cc:407] Connection header received
0807 15:20:29.081087 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.081092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.081253 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.081391 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.081781 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.082880 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.084101 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.084742 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.084967 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.085121 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.085659 (+ 538us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.085784 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":107,"threads_started":1}
I20260807 15:20:29.086292 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.080162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52162 (local address 127.15.242.195:41023)
0807 15:20:29.080478 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.080491 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.080543 (+ 52us) server_negotiation.cc:407] Connection header received
0807 15:20:29.080694 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.080699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.080957 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.081122 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.081546 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.082395 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.084347 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.085167 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.085326 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.085450 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.086025 (+ 575us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.086157 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":120,"threads_started":1}
I20260807 15:20:29.085582 28678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.079391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:43779 (local address 127.0.0.1:39774)
0807 15:20:29.080041 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.080085 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.080229 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.081533 (+ 1304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.081535 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.081551 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.081655 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.081661 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.083008 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.083011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.083980 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.083989 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.084950 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.084955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.085079 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.085117 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.085269 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.085396 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"mutex_wait_us":14,"spinlock_wait_cycles":4864,"thread_start_us":104,"threads_started":1}
I20260807 15:20:29.085927 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.079653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:41023 (local address 127.0.0.1:52162)
0807 15:20:29.080465 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.080478 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.080572 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.081270 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.081285 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.081308 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.081412 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.081419 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.082511 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.082516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.084221 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.084232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.085534 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.085538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.085622 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.085644 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.085714 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.085789 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"mutex_wait_us":341,"thread_start_us":99,"threads_started":1}
I20260807 15:20:29.089102 28541 tablet_service.cc:1467] Processing CreateTablet for tablet 58df25c679fd4b058a5ddccb0fe95c88 (DEFAULT_TABLE table=test-table [id=3aabc28eee0d4c5a92046c0b9e62c9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.089174 28073 tablet_service.cc:1467] Processing CreateTablet for tablet 58df25c679fd4b058a5ddccb0fe95c88 (DEFAULT_TABLE table=test-table [id=3aabc28eee0d4c5a92046c0b9e62c9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.089284 28300 tablet_service.cc:1467] Processing CreateTablet for tablet 58df25c679fd4b058a5ddccb0fe95c88 (DEFAULT_TABLE table=test-table [id=3aabc28eee0d4c5a92046c0b9e62c9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.090303 28073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58df25c679fd4b058a5ddccb0fe95c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.090303 28300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58df25c679fd4b058a5ddccb0fe95c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.090322 28541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58df25c679fd4b058a5ddccb0fe95c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.097961 28682 tablet_bootstrap.cc:492] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Bootstrap starting.
I20260807 15:20:29.099267 28684 tablet_bootstrap.cc:492] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Bootstrap starting.
I20260807 15:20:29.099345 28683 tablet_bootstrap.cc:492] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Bootstrap starting.
I20260807 15:20:29.101199 28684 tablet_bootstrap.cc:654] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.101197 28682 tablet_bootstrap.cc:654] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.101363 28683 tablet_bootstrap.cc:654] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.102041 28684 log.cc:824] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:29.102146 28683 log.cc:824] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:29.102146 28682 log.cc:824] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:29.104081 28682 tablet_bootstrap.cc:492] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: No bootstrap required, opened a new log
I20260807 15:20:29.104164 28684 tablet_bootstrap.cc:492] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: No bootstrap required, opened a new log
I20260807 15:20:29.104337 28682 ts_tablet_manager.cc:1397] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 15:20:29.104362 28684 ts_tablet_manager.cc:1397] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 15:20:29.105659 28683 tablet_bootstrap.cc:492] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: No bootstrap required, opened a new log
I20260807 15:20:29.105880 28683 ts_tablet_manager.cc:1397] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 15:20:29.107566 28682 raft_consensus.cc:348] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.107837 28682 raft_consensus.cc:374] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.107894 28682 raft_consensus.cc:729] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d68c7327aaa848cbab9889c0e0626259, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.108364 28682 consensus_queue.cc:260] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.109100 28640 heartbeater.cc:503] Master 127.15.242.254:44647 was elected leader, sending a full tablet report...
I20260807 15:20:29.108986 28684 raft_consensus.cc:348] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.109229 28684 raft_consensus.cc:374] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.109277 28684 raft_consensus.cc:729] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d24c694ec974700878d76d1cac31258, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.109480 28682 ts_tablet_manager.cc:1428] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 15:20:29.109683 28684 consensus_queue.cc:260] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.109786 28683 raft_consensus.cc:348] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.110034 28683 raft_consensus.cc:374] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.110102 28683 raft_consensus.cc:729] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d2372c93e684800bfa246ba07820c26, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.110499 28187 heartbeater.cc:503] Master 127.15.242.254:44647 was elected leader, sending a full tablet report...
I20260807 15:20:29.110579 28683 consensus_queue.cc:260] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.110744 28684 ts_tablet_manager.cc:1428] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:20:29.111203 28425 heartbeater.cc:503] Master 127.15.242.254:44647 was elected leader, sending a full tablet report...
I20260807 15:20:29.112023 28683 ts_tablet_manager.cc:1428] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260807 15:20:29.257091 28426 tablet.cc:2369] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:20:29.260568 28641 tablet.cc:2369] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:20:29.271268 28695 raft_consensus.cc:482] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:29.271533 28695 raft_consensus.cc:504] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.272886 28695 leader_election.cc:288] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287), d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:29.278342 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.273292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:54955 (local address 127.15.242.195:41023)
0807 15:20:29.273425 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.273429 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.273653 (+ 224us) server_negotiation.cc:407] Connection header received
0807 15:20:29.273835 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.273840 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.273898 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.273974 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.274340 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.275163 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.276956 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.277567 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.277692 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.277790 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.278130 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.278197 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 15:20:29.278342 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.273258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:59431 (local address 127.15.242.193:38287)
0807 15:20:29.273431 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.273437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.273897 (+ 460us) server_negotiation.cc:407] Connection header received
0807 15:20:29.274053 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.274056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.274109 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.274180 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.274442 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.275178 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.276956 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.277569 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.277693 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.277748 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.278121 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.278197 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 15:20:29.278422 28698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.273154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38287 (local address 127.15.242.194:59431)
0807 15:20:29.273815 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.273830 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.273939 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.274210 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.274213 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.274228 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.274340 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.274345 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.275298 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.275302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.276820 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.276832 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.277722 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.277726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.277936 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.278009 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.278098 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.278206 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":530,"thread_start_us":78,"threads_started":1}
I20260807 15:20:29.278426 28697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.273151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:41023 (local address 127.15.242.194:54955)
0807 15:20:29.273552 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.273564 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.273691 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.274066 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.274068 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.274080 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.274210 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.274216 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.275298 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.275302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.276821 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.276832 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.277722 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.277726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.277911 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.278004 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.278089 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.278206 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":210,"thread_start_us":102,"threads_started":1}
I20260807 15:20:29.279042 28104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58df25c679fd4b058a5ddccb0fe95c88" candidate_uuid: "2d2372c93e684800bfa246ba07820c26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d24c694ec974700878d76d1cac31258" is_pre_election: true
I20260807 15:20:29.279080 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58df25c679fd4b058a5ddccb0fe95c88" candidate_uuid: "2d2372c93e684800bfa246ba07820c26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d68c7327aaa848cbab9889c0e0626259" is_pre_election: true
I20260807 15:20:29.279372 28570 raft_consensus.cc:2454] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d2372c93e684800bfa246ba07820c26 in term 0.
I20260807 15:20:29.279363 28104 raft_consensus.cc:2454] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d2372c93e684800bfa246ba07820c26 in term 0.
I20260807 15:20:29.279889 28225 leader_election.cc:302] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2d2372c93e684800bfa246ba07820c26, 3d24c694ec974700878d76d1cac31258, d68c7327aaa848cbab9889c0e0626259; no voters:
I20260807 15:20:29.280184 28695 raft_consensus.cc:2781] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:29.280278 28695 raft_consensus.cc:482] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:29.280323 28695 raft_consensus.cc:3037] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Advancing to term 1
W20260807 15:20:29.281075 28188 tablet.cc:2369] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:20:29.281694 28695 raft_consensus.cc:504] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.282042 28695 leader_election.cc:288] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [CANDIDATE]: Term 1 election: Requested vote from peers 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287), d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:29.282400 28104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58df25c679fd4b058a5ddccb0fe95c88" candidate_uuid: "2d2372c93e684800bfa246ba07820c26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d24c694ec974700878d76d1cac31258"
I20260807 15:20:29.282405 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58df25c679fd4b058a5ddccb0fe95c88" candidate_uuid: "2d2372c93e684800bfa246ba07820c26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d68c7327aaa848cbab9889c0e0626259"
I20260807 15:20:29.282541 28570 raft_consensus.cc:3037] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:29.282534 28104 raft_consensus.cc:3037] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:29.283739 28104 raft_consensus.cc:2454] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d2372c93e684800bfa246ba07820c26 in term 1.
I20260807 15:20:29.284056 28570 raft_consensus.cc:2454] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d2372c93e684800bfa246ba07820c26 in term 1.
I20260807 15:20:29.284121 28228 leader_election.cc:302] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d2372c93e684800bfa246ba07820c26, 3d24c694ec974700878d76d1cac31258; no voters:
I20260807 15:20:29.284315 28695 raft_consensus.cc:2781] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:29.284507 28695 raft_consensus.cc:686] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 1 LEADER]: Becoming Leader. State: Replica: 2d2372c93e684800bfa246ba07820c26, State: Running, Role: LEADER
I20260807 15:20:29.284941 28695 consensus_queue.cc:237] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.288079 27854 catalog_manager.cc:5495] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d2372c93e684800bfa246ba07820c26 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "2d2372c93e684800bfa246ba07820c26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260807 15:20:29.326637 28681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.322978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39788 (local address 127.15.242.194:43779)
0807 15:20:29.323126 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.323129 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.323146 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:20:29.323236 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.323238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.323300 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.323403 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:29.323726 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.324231 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.325190 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.325421 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.325504 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.325761 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:29.326273 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:29.326365 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.326463 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.326517 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 15:20:29.333227 28104 raft_consensus.cc:1261] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Refusing update from remote peer 2d2372c93e684800bfa246ba07820c26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:29.333247 28570 raft_consensus.cc:1261] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Refusing update from remote peer 2d2372c93e684800bfa246ba07820c26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:29.334043 28699 consensus_queue.cc:1035] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:29.334293 28695 consensus_queue.cc:1035] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:29.342450 28703 mvcc.cc:205] Tried to move back new op lower bound from 7315931256141053952 to 7315931255953711104. Current Snapshot: MvccSnapshot[applied={T|T < 7315931256141053952}]
I20260807 15:20:29.346112 28704 mvcc.cc:205] Tried to move back new op lower bound from 7315931256141053952 to 7315931255953711104. Current Snapshot: MvccSnapshot[applied={T|T < 7315931256141053952}]
I20260807 15:20:29.351557 27854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:29.351758 27854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:29.354749 27854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: Sending DeleteTablet for 3 replicas of tablet 58df25c679fd4b058a5ddccb0fe95c88
I20260807 15:20:29.355602 28300 tablet_service.cc:1514] Processing DeleteTablet for tablet 58df25c679fd4b058a5ddccb0fe95c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:29 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:39774
I20260807 15:20:29.355614 28073 tablet_service.cc:1514] Processing DeleteTablet for tablet 58df25c679fd4b058a5ddccb0fe95c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:29 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:36956
I20260807 15:20:29.355934 28541 tablet_service.cc:1514] Processing DeleteTablet for tablet 58df25c679fd4b058a5ddccb0fe95c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:29 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:52162
I20260807 15:20:29.356534 28719 tablet_replica.cc:330] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: stopping tablet replica
I20260807 15:20:29.356652 28720 tablet_replica.cc:330] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: stopping tablet replica
I20260807 15:20:29.356973 28719 raft_consensus.cc:2229] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:29.356993 28720 raft_consensus.cc:2229] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:20:29.356980 27854 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 15:20:29.357365 28719 raft_consensus.cc:2258] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:29.357372 28720 raft_consensus.cc:2258] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 15:20:29.357417 27854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:29.358095 28722 tablet_replica.cc:330] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: stopping tablet replica
I20260807 15:20:29.358541 28722 raft_consensus.cc:2229] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:29.358934 28722 raft_consensus.cc:2258] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:29.359035 28719 ts_tablet_manager.cc:1905] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:29.360725 28720 ts_tablet_manager.cc:1905] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:29.362339 28719 ts_tablet_manager.cc:1918] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:29.362460 28719 log.cc:1196] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/58df25c679fd4b058a5ddccb0fe95c88
I20260807 15:20:29.362869 28719 ts_tablet_manager.cc:1939] T 58df25c679fd4b058a5ddccb0fe95c88 P 3d24c694ec974700878d76d1cac31258: Deleting consensus metadata
I20260807 15:20:29.364029 28720 ts_tablet_manager.cc:1918] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:29.364221 28720 log.cc:1196] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/58df25c679fd4b058a5ddccb0fe95c88
I20260807 15:20:29.364164 28073 tablet_service.cc:1467] Processing CreateTablet for tablet 31ff18358cdf483e9ef85d2fffb8ea83 (DEFAULT_TABLE table=test-table [id=4ff365d020144aee97ade7f42ed874ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.364460 28073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31ff18358cdf483e9ef85d2fffb8ea83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.364578 28720 ts_tablet_manager.cc:1939] T 58df25c679fd4b058a5ddccb0fe95c88 P 2d2372c93e684800bfa246ba07820c26: Deleting consensus metadata
I20260807 15:20:29.365150 28722 ts_tablet_manager.cc:1905] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:29.366253 28541 tablet_service.cc:1467] Processing CreateTablet for tablet 31ff18358cdf483e9ef85d2fffb8ea83 (DEFAULT_TABLE table=test-table [id=4ff365d020144aee97ade7f42ed874ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.366540 28541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31ff18358cdf483e9ef85d2fffb8ea83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.366991 28684 tablet_bootstrap.cc:492] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: Bootstrap starting.
I20260807 15:20:29.367976 28722 ts_tablet_manager.cc:1918] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:29.368083 28684 tablet_bootstrap.cc:654] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.368105 28722 log.cc:1196] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/58df25c679fd4b058a5ddccb0fe95c88
I20260807 15:20:29.368458 28722 ts_tablet_manager.cc:1939] T 58df25c679fd4b058a5ddccb0fe95c88 P d68c7327aaa848cbab9889c0e0626259: Deleting consensus metadata
I20260807 15:20:29.369083 28682 tablet_bootstrap.cc:492] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: Bootstrap starting.
I20260807 15:20:29.369511 28684 tablet_bootstrap.cc:492] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: No bootstrap required, opened a new log
I20260807 15:20:29.369597 28684 ts_tablet_manager.cc:1397] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:29.370023 28682 tablet_bootstrap.cc:654] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.370426 27839 catalog_manager.cc:4841] TS d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023): tablet 58df25c679fd4b058a5ddccb0fe95c88 (table test-table [id=3aabc28eee0d4c5a92046c0b9e62c9c3]) successfully deleted
I20260807 15:20:29.370493 28684 raft_consensus.cc:348] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.370610 28684 raft_consensus.cc:374] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.370654 28684 raft_consensus.cc:729] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d24c694ec974700878d76d1cac31258, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.370813 28684 consensus_queue.cc:260] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.371058 27841 catalog_manager.cc:4841] TS 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287): tablet 58df25c679fd4b058a5ddccb0fe95c88 (table test-table [id=3aabc28eee0d4c5a92046c0b9e62c9c3]) successfully deleted
I20260807 15:20:29.371249 28682 tablet_bootstrap.cc:492] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: No bootstrap required, opened a new log
I20260807 15:20:29.371321 28682 ts_tablet_manager.cc:1397] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:29.371507 27842 catalog_manager.cc:4841] TS 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779): tablet 58df25c679fd4b058a5ddccb0fe95c88 (table test-table [id=3aabc28eee0d4c5a92046c0b9e62c9c3]) successfully deleted
I20260807 15:20:29.371726 28684 ts_tablet_manager.cc:1428] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:29.371749 28682 raft_consensus.cc:348] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.371850 28682 raft_consensus.cc:374] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.371881 28682 raft_consensus.cc:729] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d68c7327aaa848cbab9889c0e0626259, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.372020 28682 consensus_queue.cc:260] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.372262 28682 ts_tablet_manager.cc:1428] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:29.372234 28300 tablet_service.cc:1467] Processing CreateTablet for tablet 31ff18358cdf483e9ef85d2fffb8ea83 (DEFAULT_TABLE table=test-table [id=4ff365d020144aee97ade7f42ed874ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.372536 28300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31ff18358cdf483e9ef85d2fffb8ea83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.375317 28683 tablet_bootstrap.cc:492] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: Bootstrap starting.
I20260807 15:20:29.376164 28683 tablet_bootstrap.cc:654] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.377487 28683 tablet_bootstrap.cc:492] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: No bootstrap required, opened a new log
I20260807 15:20:29.377602 28683 ts_tablet_manager.cc:1397] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 15:20:29.378036 28683 raft_consensus.cc:348] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.378160 28683 raft_consensus.cc:374] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.378213 28683 raft_consensus.cc:729] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d2372c93e684800bfa246ba07820c26, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.378373 28683 consensus_queue.cc:260] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.378763 28683 ts_tablet_manager.cc:1428] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 15:20:29.431751 28693 raft_consensus.cc:482] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:29.431959 28693 raft_consensus.cc:504] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.433296 28693 leader_election.cc:288] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779), d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:29.438083 28728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.433494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:43779 (local address 127.15.242.193:34051)
0807 15:20:29.433912 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.433928 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.434094 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.434395 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.434399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.434418 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.434587 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.434599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.435650 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.435654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.436623 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.436635 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.437495 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.437500 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.437624 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.437670 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.437764 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.437864 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":126,"threads_started":1}
I20260807 15:20:29.438090 28681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.433987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:34051 (local address 127.15.242.194:43779)
0807 15:20:29.434142 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.434147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.434163 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:20:29.434227 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.434231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.434285 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.434372 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.434697 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.435513 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.436807 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.437313 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.437462 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.437526 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.437808 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.437922 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:20:29.439024 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.433842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:49423 (local address 127.15.242.195:41023)
0807 15:20:29.433978 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.433985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.434230 (+ 245us) server_negotiation.cc:407] Connection header received
0807 15:20:29.434473 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.434476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.434533 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.434623 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.435015 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.435710 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.437198 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.437826 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.437966 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.438029 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.438793 (+ 764us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.438879 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 15:20:29.438992 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31ff18358cdf483e9ef85d2fffb8ea83" candidate_uuid: "3d24c694ec974700878d76d1cac31258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d2372c93e684800bfa246ba07820c26" is_pre_election: true
I20260807 15:20:29.439311 28338 raft_consensus.cc:2454] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d24c694ec974700878d76d1cac31258 in term 0.
I20260807 15:20:29.439563 28727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.433583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:41023 (local address 127.15.242.193:49423)
0807 15:20:29.434140 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.434156 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.434319 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.434786 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.434789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.434805 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.434899 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.434903 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.435824 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.435828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.437048 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.437061 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.438108 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.438113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.438626 (+ 513us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.438655 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.439324 (+ 669us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.439417 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":137,"threads_started":1}
I20260807 15:20:29.440003 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31ff18358cdf483e9ef85d2fffb8ea83" candidate_uuid: "3d24c694ec974700878d76d1cac31258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d68c7327aaa848cbab9889c0e0626259" is_pre_election: true
I20260807 15:20:29.439988 27998 leader_election.cc:302] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d2372c93e684800bfa246ba07820c26, 3d24c694ec974700878d76d1cac31258; no voters:
I20260807 15:20:29.440160 28570 raft_consensus.cc:2454] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d24c694ec974700878d76d1cac31258 in term 0.
I20260807 15:20:29.440361 28693 raft_consensus.cc:2781] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:29.440441 28693 raft_consensus.cc:482] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:29.440493 28693 raft_consensus.cc:3037] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:29.441702 28693 raft_consensus.cc:504] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.442121 28693 leader_election.cc:288] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [CANDIDATE]: Term 1 election: Requested vote from peers 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779), d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:29.442481 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31ff18358cdf483e9ef85d2fffb8ea83" candidate_uuid: "3d24c694ec974700878d76d1cac31258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d68c7327aaa848cbab9889c0e0626259"
I20260807 15:20:29.442507 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31ff18358cdf483e9ef85d2fffb8ea83" candidate_uuid: "3d24c694ec974700878d76d1cac31258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d2372c93e684800bfa246ba07820c26"
I20260807 15:20:29.442613 28338 raft_consensus.cc:3037] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:29.442622 28570 raft_consensus.cc:3037] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:29.443753 28570 raft_consensus.cc:2454] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d24c694ec974700878d76d1cac31258 in term 1.
I20260807 15:20:29.443753 28338 raft_consensus.cc:2454] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d24c694ec974700878d76d1cac31258 in term 1.
I20260807 15:20:29.444088 27996 leader_election.cc:302] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d24c694ec974700878d76d1cac31258, d68c7327aaa848cbab9889c0e0626259; no voters:
I20260807 15:20:29.444263 28693 raft_consensus.cc:2781] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:29.444533 28693 raft_consensus.cc:686] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 1 LEADER]: Becoming Leader. State: Replica: 3d24c694ec974700878d76d1cac31258, State: Running, Role: LEADER
I20260807 15:20:29.444856 28693 consensus_queue.cc:237] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.447597 27854 catalog_manager.cc:5495] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d24c694ec974700878d76d1cac31258 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "3d24c694ec974700878d76d1cac31258" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } health_report { overall_health: UNKNOWN } } }
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116028, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.254@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:29.488890 28746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.478841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44647 (local address 127.0.0.1:50120)
0807 15:20:29.479233 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.479250 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.479390 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.479699 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.479702 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.480260 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:29.480384 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.480393 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.481341 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.481344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.482212 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.482225 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.482761 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.482765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.482857 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.483539 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:29.483555 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:29.485184 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:29.487149 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:29.487158 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:29.487163 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:29.487424 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:29.487745 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:29.487747 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:29.487749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:29.487828 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:29.488351 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:29.488356 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:29.488458 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.488554 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.488668 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":148,"threads_started":1}
I20260807 15:20:29.489008 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.478875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50120 (local address 127.15.242.254:44647)
0807 15:20:29.479053 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.479059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.479341 (+ 282us) server_negotiation.cc:407] Connection header received
0807 15:20:29.479510 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.479513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.479558 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.479626 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:29.480532 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.481210 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.482362 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.482620 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.482708 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.485350 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:29.485354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:29.485357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:29.485384 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:29.487026 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.487540 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.487544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.487546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.487643 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.487927 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.487931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.487933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.488229 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:29.488342 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.488657 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.488817 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 15:20:29.493140 27854 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:50120:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 15:20:29.493968 27854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:29.499469 28073 tablet_service.cc:1467] Processing CreateTablet for tablet 584b9efb9fe3445580885ce5f4d8eb72 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6b4b4e6fbe024475b6f60f21d1cb57f3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:20:29.499469 28300 tablet_service.cc:1467] Processing CreateTablet for tablet 584b9efb9fe3445580885ce5f4d8eb72 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6b4b4e6fbe024475b6f60f21d1cb57f3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:20:29.499913 28073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584b9efb9fe3445580885ce5f4d8eb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.499912 28300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584b9efb9fe3445580885ce5f4d8eb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.499773 28541 tablet_service.cc:1467] Processing CreateTablet for tablet 584b9efb9fe3445580885ce5f4d8eb72 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6b4b4e6fbe024475b6f60f21d1cb57f3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 15:20:29.500196 28541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 584b9efb9fe3445580885ce5f4d8eb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.502795 28683 tablet_bootstrap.cc:492] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: Bootstrap starting.
I20260807 15:20:29.503649 28683 tablet_bootstrap.cc:654] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.504055 28682 tablet_bootstrap.cc:492] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: Bootstrap starting.
I20260807 15:20:29.504499 28684 tablet_bootstrap.cc:492] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: Bootstrap starting.
I20260807 15:20:29.505115 28682 tablet_bootstrap.cc:654] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.505564 28684 tablet_bootstrap.cc:654] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.506560 28683 tablet_bootstrap.cc:492] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: No bootstrap required, opened a new log
I20260807 15:20:29.506673 28683 ts_tablet_manager.cc:1397] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 15:20:29.506861 28684 tablet_bootstrap.cc:492] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: No bootstrap required, opened a new log
I20260807 15:20:29.506968 28684 ts_tablet_manager.cc:1397] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:29.507150 28683 raft_consensus.cc:348] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.507280 28683 raft_consensus.cc:374] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.507323 28683 raft_consensus.cc:729] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d2372c93e684800bfa246ba07820c26, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.507470 28683 consensus_queue.cc:260] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.507452 28684 raft_consensus.cc:348] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.507577 28684 raft_consensus.cc:374] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.507625 28684 raft_consensus.cc:729] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d24c694ec974700878d76d1cac31258, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.507782 28684 consensus_queue.cc:260] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.508041 28693 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.508191 28693 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:20:29.508281 28709 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.508417 28709 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:20:29.508883 28684 ts_tablet_manager.cc:1428] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:29.509239 28683 ts_tablet_manager.cc:1428] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:29.511256 28682 tablet_bootstrap.cc:492] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: No bootstrap required, opened a new log
I20260807 15:20:29.511341 28682 ts_tablet_manager.cc:1397] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260807 15:20:29.511790 28682 raft_consensus.cc:348] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.511906 28682 raft_consensus.cc:374] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.511934 28682 raft_consensus.cc:729] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d68c7327aaa848cbab9889c0e0626259, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.512063 28682 consensus_queue.cc:260] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.512310 28682 ts_tablet_manager.cc:1428] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:29.512547 28691 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.512688 28691 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:20:29.759419 28691 raft_consensus.cc:482] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:29.759600 28691 raft_consensus.cc:504] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.760893 28691 leader_election.cc:288] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287), 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779)
I20260807 15:20:29.765640 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.761275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:37153 (local address 127.15.242.193:38287)
0807 15:20:29.761405 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.761410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.761686 (+ 276us) server_negotiation.cc:407] Connection header received
0807 15:20:29.761906 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.761911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.761965 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.762043 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.762339 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.763133 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.764502 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.765080 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.765207 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.765261 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.765451 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.765522 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 15:20:29.765674 28759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.761131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38287 (local address 127.15.242.195:37153)
0807 15:20:29.761593 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.761608 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.761763 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.762069 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.762072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.762085 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.762209 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.762239 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.763252 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.763255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.764361 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.764367 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.765202 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.765205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.765310 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.765333 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.765432 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.765505 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":1,"thread_start_us":75,"threads_started":1}
I20260807 15:20:29.765841 28681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.761306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:58239 (local address 127.15.242.194:43779)
0807 15:20:29.761429 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.761433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.761913 (+ 480us) server_negotiation.cc:407] Connection header received
0807 15:20:29.762054 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.762058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.762108 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.762189 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:29.762416 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.762916 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.764480 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.765150 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.765260 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.765309 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.765651 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.765729 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 15:20:29.766192 28104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584b9efb9fe3445580885ce5f4d8eb72" candidate_uuid: "d68c7327aaa848cbab9889c0e0626259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d24c694ec974700878d76d1cac31258" is_pre_election: true
I20260807 15:20:29.766363 28104 raft_consensus.cc:2454] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d68c7327aaa848cbab9889c0e0626259 in term 0.
I20260807 15:20:29.766513 28760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.761131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:43779 (local address 127.15.242.195:58239)
0807 15:20:29.761791 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.761803 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.761946 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.762200 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.762203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.762217 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:29.762312 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.762320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.763033 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.763038 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.764336 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.764348 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.765398 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.765402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.765508 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.765530 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.766294 (+ 764us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.766373 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":352,"thread_start_us":73,"threads_started":1}
I20260807 15:20:29.766710 28462 leader_election.cc:302] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d24c694ec974700878d76d1cac31258, d68c7327aaa848cbab9889c0e0626259; no voters:
I20260807 15:20:29.766958 28691 raft_consensus.cc:2781] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:29.767027 28691 raft_consensus.cc:482] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:29.767009 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584b9efb9fe3445580885ce5f4d8eb72" candidate_uuid: "d68c7327aaa848cbab9889c0e0626259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d2372c93e684800bfa246ba07820c26" is_pre_election: true
I20260807 15:20:29.767079 28691 raft_consensus.cc:3037] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:29.767130 28338 raft_consensus.cc:2454] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d68c7327aaa848cbab9889c0e0626259 in term 0.
I20260807 15:20:29.768338 28691 raft_consensus.cc:504] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.768745 28691 leader_election.cc:288] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [CANDIDATE]: Term 1 election: Requested vote from peers 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287), 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779)
I20260807 15:20:29.769068 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584b9efb9fe3445580885ce5f4d8eb72" candidate_uuid: "d68c7327aaa848cbab9889c0e0626259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d2372c93e684800bfa246ba07820c26"
I20260807 15:20:29.769075 28104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "584b9efb9fe3445580885ce5f4d8eb72" candidate_uuid: "d68c7327aaa848cbab9889c0e0626259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d24c694ec974700878d76d1cac31258"
I20260807 15:20:29.769169 28104 raft_consensus.cc:3037] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:29.769168 28338 raft_consensus.cc:3037] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:29.769992 28104 raft_consensus.cc:2454] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d68c7327aaa848cbab9889c0e0626259 in term 1.
I20260807 15:20:29.770260 28338 raft_consensus.cc:2454] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d68c7327aaa848cbab9889c0e0626259 in term 1.
I20260807 15:20:29.770251 28462 leader_election.cc:302] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d24c694ec974700878d76d1cac31258, d68c7327aaa848cbab9889c0e0626259; no voters:
I20260807 15:20:29.770433 28691 raft_consensus.cc:2781] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:29.770628 28691 raft_consensus.cc:686] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [term 1 LEADER]: Becoming Leader. State: Replica: d68c7327aaa848cbab9889c0e0626259, State: Running, Role: LEADER
I20260807 15:20:29.770889 28691 consensus_queue.cc:237] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.772172 28761 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: TxnStatusTablet state changed. Reason: New leader d68c7327aaa848cbab9889c0e0626259. Latest consensus state: current_term: 1 leader_uuid: "d68c7327aaa848cbab9889c0e0626259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.772301 28761 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:20:29.773432 27854 catalog_manager.cc:5495] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 reported cstate change: term changed from 0 to 1, leader changed from <none> to d68c7327aaa848cbab9889c0e0626259 (127.15.242.195). New cstate: current_term: 1 leader_uuid: "d68c7327aaa848cbab9889c0e0626259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260807 15:20:29.773830 28768 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 15:20:29.773995 28768 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 15:20:29.812310 28746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.807693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:41023 (local address 127.0.0.1:52172)
0807 15:20:29.807908 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.807926 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.808051 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.808400 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.808402 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.808409 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:20:29.808510 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.808514 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.809587 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.809589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.810225 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.810235 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.810875 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.810878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.811006 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.811068 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:20:29.811961 (+ 893us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:20:29.811979 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.812094 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.812195 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 15:20:29.812314 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.807912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52172 (local address 127.15.242.195:41023)
0807 15:20:29.808074 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.808079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.808096 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:20:29.808193 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.808196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.808267 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.808376 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:29.808630 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.809456 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.810372 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.810729 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.810835 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.811281 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:29.811852 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:29.811970 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.812108 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.812169 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 15:20:29.815866 28104 raft_consensus.cc:1261] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Refusing update from remote peer d68c7327aaa848cbab9889c0e0626259: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:29.816071 28338 raft_consensus.cc:1261] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Refusing update from remote peer d68c7327aaa848cbab9889c0e0626259: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:29.816670 28761 consensus_queue.cc:1035] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:29.816902 28691 consensus_queue.cc:1035] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:29.818725 28709 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: TxnStatusTablet state changed. Reason: New leader d68c7327aaa848cbab9889c0e0626259. Latest consensus state: current_term: 1 leader_uuid: "d68c7327aaa848cbab9889c0e0626259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.818853 28709 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:20:29.819972 28693 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: TxnStatusTablet state changed. Reason: New leader d68c7327aaa848cbab9889c0e0626259. Latest consensus state: current_term: 1 leader_uuid: "d68c7327aaa848cbab9889c0e0626259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.820102 28693 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:20:29.821666 28761 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d68c7327aaa848cbab9889c0e0626259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.821784 28761 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:20:29.821928 28761 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d68c7327aaa848cbab9889c0e0626259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.822006 28761 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P d68c7327aaa848cbab9889c0e0626259: This TxnStatusTablet replica's current role is: LEADER
I20260807 15:20:29.822422 28693 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d68c7327aaa848cbab9889c0e0626259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.822521 28693 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P 3d24c694ec974700878d76d1cac31258: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:20:29.824642 28709 tablet_replica.cc:439] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d68c7327aaa848cbab9889c0e0626259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } } }
I20260807 15:20:29.824791 28709 tablet_replica.cc:442] T 584b9efb9fe3445580885ce5f4d8eb72 P 2d2372c93e684800bfa246ba07820c26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 15:20:29.825141 28706 mvcc.cc:205] Tried to move back new op lower bound from 7315931258119143424 to 7315931257944092672. Current Snapshot: MvccSnapshot[applied={T|T < 7315931258119143424 or (T in {7315931258119143424})}]
I20260807 15:20:29.834266 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.828938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36968 (local address 127.15.242.193:38287)
0807 15:20:29.829084 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.829090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.829562 (+ 472us) server_negotiation.cc:407] Connection header received
0807 15:20:29.829713 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.829716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.829799 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.829927 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:29.830374 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.831178 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.832184 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.832531 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.832638 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.833154 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:29.833785 (+ 631us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:29.833907 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.834040 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.834111 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:20:29.846782 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.842917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:57577 (local address 127.15.242.195:41023)
0807 15:20:29.843052 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.843057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.843210 (+ 153us) server_negotiation.cc:407] Connection header received
0807 15:20:29.843330 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.843333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.843388 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.843471 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:29.843814 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.844591 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.845595 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.845953 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.846057 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.846337 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:29.846423 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:29.846497 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.846572 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.846627 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 15:20:29.846822 28786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.842772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:41023 (local address 127.15.242.193:57577)
0807 15:20:29.843120 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.843135 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.843233 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.843503 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.843507 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.843515 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:20:29.843702 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.843709 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.844736 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.844739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.845474 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.845485 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.846080 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.846083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.846159 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.846207 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:20:29.846507 (+ 300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:20:29.846512 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.846561 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.846629 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":132,"threads_started":1}
I20260807 15:20:29.854910 28338 raft_consensus.cc:1261] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Refusing update from remote peer 3d24c694ec974700878d76d1cac31258: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:29.855022 28570 raft_consensus.cc:1261] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Refusing update from remote peer 3d24c694ec974700878d76d1cac31258: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:29.855443 28693 consensus_queue.cc:1035] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:29.855715 28734 consensus_queue.cc:1035] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:29.880666 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.876270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:33365 (local address 127.15.242.193:38287)
0807 15:20:29.876379 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.876384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.876517 (+ 133us) server_negotiation.cc:407] Connection header received
0807 15:20:29.876932 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.876936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.877009 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.877119 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:29.877455 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.878281 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.879448 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.879704 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.879827 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.880157 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:29.880250 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:29.880342 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.880461 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.880515 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:20:29.880679 28793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.876175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38287 (local address 127.15.242.195:33365)
0807 15:20:29.876420 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:29.876434 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:29.876573 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:29.877135 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:29.877138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:29.877148 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 15:20:29.877325 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.877333 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.878447 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.878451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.879314 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:29.879325 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.879829 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.879833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:29.879948 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.879997 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 15:20:29.880347 (+ 350us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 15:20:29.880357 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 15:20:29.880431 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 15:20:29.880519 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":56,"threads_started":1}
I20260807 15:20:29.909292 27854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:29.909479 27854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:29.911942 27854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: Sending DeleteTablet for 3 replicas of tablet 31ff18358cdf483e9ef85d2fffb8ea83
I20260807 15:20:29.912569 28073 tablet_service.cc:1514] Processing DeleteTablet for tablet 31ff18358cdf483e9ef85d2fffb8ea83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:29 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:36956
I20260807 15:20:29.912977 28541 tablet_service.cc:1514] Processing DeleteTablet for tablet 31ff18358cdf483e9ef85d2fffb8ea83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:29 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:52162
I20260807 15:20:29.913185 28300 tablet_service.cc:1514] Processing DeleteTablet for tablet 31ff18358cdf483e9ef85d2fffb8ea83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:29 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:39774
I20260807 15:20:29.913709 28800 tablet_replica.cc:330] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: stopping tablet replica
I20260807 15:20:29.913923 28800 raft_consensus.cc:2229] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:29.913990 28799 tablet_replica.cc:330] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: stopping tablet replica
I20260807 15:20:29.914130 28799 raft_consensus.cc:2229] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:29.914172 28800 raft_consensus.cc:2258] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:29.914278 28799 raft_consensus.cc:2258] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:29.914867 28798 tablet_replica.cc:330] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: stopping tablet replica
I20260807 15:20:29.915002 28799 ts_tablet_manager.cc:1905] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:29.915171 28798 raft_consensus.cc:2229] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:20:29.915580 28798 raft_consensus.cc:2258] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:29.916417 28798 ts_tablet_manager.cc:1905] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:29.918303 28799 ts_tablet_manager.cc:1918] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:20:29.918411 28799 log.cc:1196] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/31ff18358cdf483e9ef85d2fffb8ea83
I20260807 15:20:29.918668 28800 ts_tablet_manager.cc:1905] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:29.918757 28799 ts_tablet_manager.cc:1939] T 31ff18358cdf483e9ef85d2fffb8ea83 P d68c7327aaa848cbab9889c0e0626259: Deleting consensus metadata
I20260807 15:20:29.919512 27839 catalog_manager.cc:4841] TS d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023): tablet 31ff18358cdf483e9ef85d2fffb8ea83 (table test-table [id=4ff365d020144aee97ade7f42ed874ac]) successfully deleted
I20260807 15:20:29.920025 28798 ts_tablet_manager.cc:1918] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:20:29.920114 28798 log.cc:1196] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/31ff18358cdf483e9ef85d2fffb8ea83
I20260807 15:20:29.920405 28798 ts_tablet_manager.cc:1939] T 31ff18358cdf483e9ef85d2fffb8ea83 P 3d24c694ec974700878d76d1cac31258: Deleting consensus metadata
I20260807 15:20:29.921216 27841 catalog_manager.cc:4841] TS 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287): tablet 31ff18358cdf483e9ef85d2fffb8ea83 (table test-table [id=4ff365d020144aee97ade7f42ed874ac]) successfully deleted
I20260807 15:20:29.921710 28800 ts_tablet_manager.cc:1918] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:20:29.921815 28800 log.cc:1196] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/31ff18358cdf483e9ef85d2fffb8ea83
I20260807 15:20:29.922053 28800 ts_tablet_manager.cc:1939] T 31ff18358cdf483e9ef85d2fffb8ea83 P 2d2372c93e684800bfa246ba07820c26: Deleting consensus metadata
I20260807 15:20:29.922745 27842 catalog_manager.cc:4841] TS 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779): tablet 31ff18358cdf483e9ef85d2fffb8ea83 (table test-table [id=4ff365d020144aee97ade7f42ed874ac]) successfully deleted
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 15:20:29.947871 27935 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:29.941669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50132 (local address 127.15.242.254:44647)
0807 15:20:29.941823 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.941828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.941842 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:29.941896 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.941898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.941939 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.942033 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:29.942783 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.943467 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.944344 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.944599 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.944710 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.947765 (+ 3055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50132: BlockingRecv error: recv got EOF from 127.0.0.1:50132 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 15:20:29 dist-test-slave-g170 krb5kdc[27793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM
I20260807 15:20:29.959030 27935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:29.950174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50146 (local address 127.15.242.254:44647)
0807 15:20:29.950304 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:29.950308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:29.950660 (+ 352us) server_negotiation.cc:407] Connection header received
0807 15:20:29.950806 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:29.950809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:29.950852 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:29.950944 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:29.951535 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.952039 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.952931 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:29.953203 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:29.953336 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:29.955652 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:29.955656 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:29.955659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:29.955690 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:29.957212 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.957648 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.957652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.957654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.957737 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:29.958031 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:29.958034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:29.958036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:29.958218 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:29.958374 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:29.958745 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 15:20:29.958870 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 15:20:29.962105 27854 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:20:29.962592 27854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:29.967941 28073 tablet_service.cc:1467] Processing CreateTablet for tablet 865dd4cdbbac434a8bfe1abb06ee5f28 (DEFAULT_TABLE table=test-table [id=a2f2d6e0358b4b3aa0f08bb1d4611d7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.968182 28541 tablet_service.cc:1467] Processing CreateTablet for tablet 865dd4cdbbac434a8bfe1abb06ee5f28 (DEFAULT_TABLE table=test-table [id=a2f2d6e0358b4b3aa0f08bb1d4611d7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.968292 28073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 865dd4cdbbac434a8bfe1abb06ee5f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.968458 28541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 865dd4cdbbac434a8bfe1abb06ee5f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.969347 28300 tablet_service.cc:1467] Processing CreateTablet for tablet 865dd4cdbbac434a8bfe1abb06ee5f28 (DEFAULT_TABLE table=test-table [id=a2f2d6e0358b4b3aa0f08bb1d4611d7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:29.969640 28300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 865dd4cdbbac434a8bfe1abb06ee5f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:29.970866 28682 tablet_bootstrap.cc:492] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: Bootstrap starting.
I20260807 15:20:29.971582 28682 tablet_bootstrap.cc:654] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.971971 28683 tablet_bootstrap.cc:492] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: Bootstrap starting.
I20260807 15:20:29.972268 28684 tablet_bootstrap.cc:492] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: Bootstrap starting.
I20260807 15:20:29.973090 28683 tablet_bootstrap.cc:654] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.973261 28684 tablet_bootstrap.cc:654] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:29.973650 28682 tablet_bootstrap.cc:492] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: No bootstrap required, opened a new log
I20260807 15:20:29.973726 28682 ts_tablet_manager.cc:1397] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 15:20:29.974125 28682 raft_consensus.cc:348] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.974247 28682 raft_consensus.cc:374] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.974278 28682 raft_consensus.cc:729] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d68c7327aaa848cbab9889c0e0626259, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.974396 28682 consensus_queue.cc:260] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.974474 28683 tablet_bootstrap.cc:492] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: No bootstrap required, opened a new log
I20260807 15:20:29.974473 28684 tablet_bootstrap.cc:492] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: No bootstrap required, opened a new log
I20260807 15:20:29.974555 28684 ts_tablet_manager.cc:1397] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:29.974555 28683 ts_tablet_manager.cc:1397] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:29.974647 28682 ts_tablet_manager.cc:1428] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:29.974962 28684 raft_consensus.cc:348] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.974962 28683 raft_consensus.cc:348] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.975068 28684 raft_consensus.cc:374] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.975070 28683 raft_consensus.cc:374] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:29.975103 28683 raft_consensus.cc:729] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d2372c93e684800bfa246ba07820c26, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.975103 28684 raft_consensus.cc:729] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d24c694ec974700878d76d1cac31258, State: Initialized, Role: FOLLOWER
I20260807 15:20:29.975232 28684 consensus_queue.cc:260] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.975232 28683 consensus_queue.cc:260] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:29.975505 28684 ts_tablet_manager.cc:1428] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:29.976631 28683 ts_tablet_manager.cc:1428] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 15:20:30.258535 28709 raft_consensus.cc:482] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:30.258693 28709 raft_consensus.cc:504] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.259310 28709 leader_election.cc:288] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287), d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:30.259927 28104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865dd4cdbbac434a8bfe1abb06ee5f28" candidate_uuid: "2d2372c93e684800bfa246ba07820c26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d24c694ec974700878d76d1cac31258" is_pre_election: true
I20260807 15:20:30.259927 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865dd4cdbbac434a8bfe1abb06ee5f28" candidate_uuid: "2d2372c93e684800bfa246ba07820c26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d68c7327aaa848cbab9889c0e0626259" is_pre_election: true
I20260807 15:20:30.260095 28570 raft_consensus.cc:2454] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d2372c93e684800bfa246ba07820c26 in term 0.
I20260807 15:20:30.260095 28104 raft_consensus.cc:2454] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d2372c93e684800bfa246ba07820c26 in term 0.
I20260807 15:20:30.260421 28225 leader_election.cc:302] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2d2372c93e684800bfa246ba07820c26, 3d24c694ec974700878d76d1cac31258, d68c7327aaa848cbab9889c0e0626259; no voters:
I20260807 15:20:30.260614 28709 raft_consensus.cc:2781] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:30.260689 28709 raft_consensus.cc:482] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:30.260717 28709 raft_consensus.cc:3037] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:30.261910 28709 raft_consensus.cc:504] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.262367 28709 leader_election.cc:288] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [CANDIDATE]: Term 1 election: Requested vote from peers 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287), d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:30.262693 28104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865dd4cdbbac434a8bfe1abb06ee5f28" candidate_uuid: "2d2372c93e684800bfa246ba07820c26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d24c694ec974700878d76d1cac31258"
I20260807 15:20:30.262722 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "865dd4cdbbac434a8bfe1abb06ee5f28" candidate_uuid: "2d2372c93e684800bfa246ba07820c26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d68c7327aaa848cbab9889c0e0626259"
I20260807 15:20:30.262845 28104 raft_consensus.cc:3037] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:30.262858 28570 raft_consensus.cc:3037] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:30.263782 28104 raft_consensus.cc:2454] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d2372c93e684800bfa246ba07820c26 in term 1.
I20260807 15:20:30.263868 28570 raft_consensus.cc:2454] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d2372c93e684800bfa246ba07820c26 in term 1.
I20260807 15:20:30.264102 28228 leader_election.cc:302] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d2372c93e684800bfa246ba07820c26, 3d24c694ec974700878d76d1cac31258; no voters:
I20260807 15:20:30.264283 28709 raft_consensus.cc:2781] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:30.264499 28709 raft_consensus.cc:686] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 1 LEADER]: Becoming Leader. State: Replica: 2d2372c93e684800bfa246ba07820c26, State: Running, Role: LEADER
I20260807 15:20:30.264680 28709 consensus_queue.cc:237] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.266548 27854 catalog_manager.cc:5495] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d2372c93e684800bfa246ba07820c26 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "2d2372c93e684800bfa246ba07820c26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260807 15:20:30.347424 28833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:30.344224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39792 (local address 127.15.242.194:43779)
0807 15:20:30.344492 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:30.344497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:30.344510 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:20:30.344558 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:30.344560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:30.344603 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:30.344681 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:30.344966 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:30.345504 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:30.346336 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:30.346561 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:30.346641 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:30.346863 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:30.346934 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:30.346990 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:30.347136 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 15:20:30.347201 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":111,"threads_started":1}
I20260807 15:20:30.349686 28104 raft_consensus.cc:1261] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Refusing update from remote peer 2d2372c93e684800bfa246ba07820c26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:30.349647 28570 raft_consensus.cc:1261] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Refusing update from remote peer 2d2372c93e684800bfa246ba07820c26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:30.350184 28709 consensus_queue.cc:1035] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:30.350375 28822 consensus_queue.cc:1035] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:30.358168 27854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:30.358296 27854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:30.360242 27854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: Sending DeleteTablet for 3 replicas of tablet 865dd4cdbbac434a8bfe1abb06ee5f28
I20260807 15:20:30.360738 28073 tablet_service.cc:1514] Processing DeleteTablet for tablet 865dd4cdbbac434a8bfe1abb06ee5f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:30 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:36956
I20260807 15:20:30.360904 28541 tablet_service.cc:1514] Processing DeleteTablet for tablet 865dd4cdbbac434a8bfe1abb06ee5f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:30 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:52162
I20260807 15:20:30.360954 28798 tablet_replica.cc:330] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: stopping tablet replica
I20260807 15:20:30.361099 28799 tablet_replica.cc:330] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: stopping tablet replica
I20260807 15:20:30.361099 28798 raft_consensus.cc:2229] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:30.361227 28798 raft_consensus.cc:2258] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:30.361227 28799 raft_consensus.cc:2229] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:30.361349 28799 raft_consensus.cc:2258] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:30.361402 28300 tablet_service.cc:1514] Processing DeleteTablet for tablet 865dd4cdbbac434a8bfe1abb06ee5f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:30 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:39774
I20260807 15:20:30.361578 28800 tablet_replica.cc:330] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: stopping tablet replica
I20260807 15:20:30.361735 28800 raft_consensus.cc:2229] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:20:30.361984 28800 raft_consensus.cc:2258] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:30.362121 28798 ts_tablet_manager.cc:1905] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:30.362624 28799 ts_tablet_manager.cc:1905] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:30.364699 28798 ts_tablet_manager.cc:1918] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:30.364814 28798 log.cc:1196] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/865dd4cdbbac434a8bfe1abb06ee5f28
I20260807 15:20:30.365093 28798 ts_tablet_manager.cc:1939] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 3d24c694ec974700878d76d1cac31258: Deleting consensus metadata
I20260807 15:20:30.365376 28799 ts_tablet_manager.cc:1918] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:30.365458 28799 log.cc:1196] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/865dd4cdbbac434a8bfe1abb06ee5f28
I20260807 15:20:30.365767 28799 ts_tablet_manager.cc:1939] T 865dd4cdbbac434a8bfe1abb06ee5f28 P d68c7327aaa848cbab9889c0e0626259: Deleting consensus metadata
I20260807 15:20:30.365825 27841 catalog_manager.cc:4841] TS 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287): tablet 865dd4cdbbac434a8bfe1abb06ee5f28 (table test-table [id=a2f2d6e0358b4b3aa0f08bb1d4611d7e]) successfully deleted
I20260807 15:20:30.366384 27839 catalog_manager.cc:4841] TS d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023): tablet 865dd4cdbbac434a8bfe1abb06ee5f28 (table test-table [id=a2f2d6e0358b4b3aa0f08bb1d4611d7e]) successfully deleted
I20260807 15:20:30.366484 27854 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 15:20:30.366789 28800 ts_tablet_manager.cc:1905] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 15:20:30.366864 27854 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:30.369153 28800 ts_tablet_manager.cc:1918] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:30.369222 28800 log.cc:1196] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/865dd4cdbbac434a8bfe1abb06ee5f28
I20260807 15:20:30.369413 28800 ts_tablet_manager.cc:1939] T 865dd4cdbbac434a8bfe1abb06ee5f28 P 2d2372c93e684800bfa246ba07820c26: Deleting consensus metadata
I20260807 15:20:30.370016 27842 catalog_manager.cc:4841] TS 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779): tablet 865dd4cdbbac434a8bfe1abb06ee5f28 (table test-table [id=a2f2d6e0358b4b3aa0f08bb1d4611d7e]) successfully deleted
I20260807 15:20:30.371448 28073 tablet_service.cc:1467] Processing CreateTablet for tablet 87756c683cae427d9cd521bba8dcd002 (DEFAULT_TABLE table=test-table [id=339b8e63a4ea417fbb1a8d992be8fb96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:30.371521 28300 tablet_service.cc:1467] Processing CreateTablet for tablet 87756c683cae427d9cd521bba8dcd002 (DEFAULT_TABLE table=test-table [id=339b8e63a4ea417fbb1a8d992be8fb96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:30.371723 28073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87756c683cae427d9cd521bba8dcd002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:30.371825 28300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87756c683cae427d9cd521bba8dcd002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:30.373198 28541 tablet_service.cc:1467] Processing CreateTablet for tablet 87756c683cae427d9cd521bba8dcd002 (DEFAULT_TABLE table=test-table [id=339b8e63a4ea417fbb1a8d992be8fb96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:30.373457 28541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87756c683cae427d9cd521bba8dcd002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:30.373762 28684 tablet_bootstrap.cc:492] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258: Bootstrap starting.
I20260807 15:20:30.373942 28683 tablet_bootstrap.cc:492] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: Bootstrap starting.
I20260807 15:20:30.374526 28684 tablet_bootstrap.cc:654] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:30.374782 28683 tablet_bootstrap.cc:654] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:30.375638 28684 tablet_bootstrap.cc:492] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258: No bootstrap required, opened a new log
I20260807 15:20:30.375741 28684 ts_tablet_manager.cc:1397] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 15:20:30.376056 28683 tablet_bootstrap.cc:492] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: No bootstrap required, opened a new log
I20260807 15:20:30.376147 28683 ts_tablet_manager.cc:1397] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 15:20:30.376160 28684 raft_consensus.cc:348] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.376288 28684 raft_consensus.cc:374] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:30.376330 28684 raft_consensus.cc:729] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d24c694ec974700878d76d1cac31258, State: Initialized, Role: FOLLOWER
I20260807 15:20:30.376456 28684 consensus_queue.cc:260] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.376552 28683 raft_consensus.cc:348] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.376657 28683 raft_consensus.cc:374] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:30.376700 28683 raft_consensus.cc:729] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d2372c93e684800bfa246ba07820c26, State: Initialized, Role: FOLLOWER
I20260807 15:20:30.376827 28684 ts_tablet_manager.cc:1428] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:30.376883 28683 consensus_queue.cc:260] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.377152 28683 ts_tablet_manager.cc:1428] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 15:20:30.377403 28682 tablet_bootstrap.cc:492] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: Bootstrap starting.
I20260807 15:20:30.378228 28682 tablet_bootstrap.cc:654] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:30.379568 28682 tablet_bootstrap.cc:492] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: No bootstrap required, opened a new log
I20260807 15:20:30.379659 28682 ts_tablet_manager.cc:1397] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 15:20:30.380051 28682 raft_consensus.cc:348] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.380172 28682 raft_consensus.cc:374] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:30.380215 28682 raft_consensus.cc:729] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d68c7327aaa848cbab9889c0e0626259, State: Initialized, Role: FOLLOWER
I20260807 15:20:30.380362 28682 consensus_queue.cc:260] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.380666 28682 ts_tablet_manager.cc:1428] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:20:30.540688 28789 raft_consensus.cc:482] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:30.540904 28789 raft_consensus.cc:504] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.541445 28789 leader_election.cc:288] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779), d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:30.541965 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87756c683cae427d9cd521bba8dcd002" candidate_uuid: "3d24c694ec974700878d76d1cac31258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d68c7327aaa848cbab9889c0e0626259" is_pre_election: true
I20260807 15:20:30.541961 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87756c683cae427d9cd521bba8dcd002" candidate_uuid: "3d24c694ec974700878d76d1cac31258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d2372c93e684800bfa246ba07820c26" is_pre_election: true
I20260807 15:20:30.542143 28338 raft_consensus.cc:2454] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d24c694ec974700878d76d1cac31258 in term 0.
I20260807 15:20:30.542158 28570 raft_consensus.cc:2454] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d24c694ec974700878d76d1cac31258 in term 0.
I20260807 15:20:30.542557 27998 leader_election.cc:302] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d2372c93e684800bfa246ba07820c26, 3d24c694ec974700878d76d1cac31258; no voters:
I20260807 15:20:30.542765 28789 raft_consensus.cc:2781] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:30.542853 28789 raft_consensus.cc:482] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:30.542914 28789 raft_consensus.cc:3037] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:30.544179 28789 raft_consensus.cc:504] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.544602 28789 leader_election.cc:288] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [CANDIDATE]: Term 1 election: Requested vote from peers 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779), d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023)
I20260807 15:20:30.545106 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87756c683cae427d9cd521bba8dcd002" candidate_uuid: "3d24c694ec974700878d76d1cac31258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d68c7327aaa848cbab9889c0e0626259"
I20260807 15:20:30.545169 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87756c683cae427d9cd521bba8dcd002" candidate_uuid: "3d24c694ec974700878d76d1cac31258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d2372c93e684800bfa246ba07820c26"
I20260807 15:20:30.545282 28338 raft_consensus.cc:3037] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:30.545285 28570 raft_consensus.cc:3037] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:30.546339 28570 raft_consensus.cc:2454] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d24c694ec974700878d76d1cac31258 in term 1.
I20260807 15:20:30.546422 28338 raft_consensus.cc:2454] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d24c694ec974700878d76d1cac31258 in term 1.
I20260807 15:20:30.546756 27996 leader_election.cc:302] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d24c694ec974700878d76d1cac31258, d68c7327aaa848cbab9889c0e0626259; no voters:
I20260807 15:20:30.546945 28789 raft_consensus.cc:2781] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:30.547142 28789 raft_consensus.cc:686] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 1 LEADER]: Becoming Leader. State: Replica: 3d24c694ec974700878d76d1cac31258, State: Running, Role: LEADER
I20260807 15:20:30.547315 28789 consensus_queue.cc:237] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } }
I20260807 15:20:30.549386 27857 catalog_manager.cc:5495] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d24c694ec974700878d76d1cac31258 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "3d24c694ec974700878d76d1cac31258" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d24c694ec974700878d76d1cac31258" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 } health_report { overall_health: UNKNOWN } } }
I20260807 15:20:30.578596 28851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:30.575241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36972 (local address 127.15.242.193:38287)
0807 15:20:30.575488 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:30.575492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:30.575520 (+ 28us) server_negotiation.cc:407] Connection header received
0807 15:20:30.575567 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:30.575570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:30.575622 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:30.575716 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:30.575981 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:30.576511 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:30.577473 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:30.577711 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:30.577829 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:30.578088 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:30.578171 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:30.578256 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:30.578373 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 15:20:30.578427 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":76,"threads_started":1}
I20260807 15:20:30.585407 28338 raft_consensus.cc:1261] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Refusing update from remote peer 3d24c694ec974700878d76d1cac31258: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:30.585497 28570 raft_consensus.cc:1261] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Refusing update from remote peer 3d24c694ec974700878d76d1cac31258: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:30.585884 28845 consensus_queue.cc:1035] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d2372c93e684800bfa246ba07820c26" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:30.586043 28789 consensus_queue.cc:1035] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d68c7327aaa848cbab9889c0e0626259" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 41023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:30.619032 27854 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:30.619177 27854 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:30.621125 27854 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d9d3ecf0ce224018b7028ca12258939f: Sending DeleteTablet for 3 replicas of tablet 87756c683cae427d9cd521bba8dcd002
I20260807 15:20:30.621704 28073 tablet_service.cc:1514] Processing DeleteTablet for tablet 87756c683cae427d9cd521bba8dcd002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:30 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:36956
I20260807 15:20:30.621830 28541 tablet_service.cc:1514] Processing DeleteTablet for tablet 87756c683cae427d9cd521bba8dcd002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:30 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:52162
I20260807 15:20:30.621831 28300 tablet_service.cc:1514] Processing DeleteTablet for tablet 87756c683cae427d9cd521bba8dcd002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:30 UTC) from {username='oryx', principal='oryx/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:39774
I20260807 15:20:30.621898 28798 tablet_replica.cc:330] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258: stopping tablet replica
I20260807 15:20:30.621994 28799 tablet_replica.cc:330] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: stopping tablet replica
I20260807 15:20:30.622021 28800 tablet_replica.cc:330] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: stopping tablet replica
I20260807 15:20:30.622030 28798 raft_consensus.cc:2229] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:20:30.622105 28799 raft_consensus.cc:2229] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:30.622143 28800 raft_consensus.cc:2229] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:30.622215 28798 raft_consensus.cc:2258] T 87756c683cae427d9cd521bba8dcd002 P 3d24c694ec974700878d76d1cac31258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:30.622233 28799 raft_consensus.cc:2258] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:30.622273 28800 raft_consensus.cc:2258] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:30.622741 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 27968
I20260807 15:20:30.628315 28800 ts_tablet_manager.cc:1905] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:30.630475 28799 ts_tablet_manager.cc:1905] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:30.631140 28800 ts_tablet_manager.cc:1918] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:20:30.631242 28800 log.cc:1196] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/87756c683cae427d9cd521bba8dcd002
I20260807 15:20:30.631546 28800 ts_tablet_manager.cc:1939] T 87756c683cae427d9cd521bba8dcd002 P 2d2372c93e684800bfa246ba07820c26: Deleting consensus metadata
I20260807 15:20:30.632606 28799 ts_tablet_manager.cc:1918] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 15:20:30.632673 28799 log.cc:1196] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/87756c683cae427d9cd521bba8dcd002
I20260807 15:20:30.632966 28799 ts_tablet_manager.cc:1939] T 87756c683cae427d9cd521bba8dcd002 P d68c7327aaa848cbab9889c0e0626259: Deleting consensus metadata
I20260807 15:20:30.632995 27842 catalog_manager.cc:4841] TS 2d2372c93e684800bfa246ba07820c26 (127.15.242.194:43779): tablet 87756c683cae427d9cd521bba8dcd002 (table test-table [id=339b8e63a4ea417fbb1a8d992be8fb96]) successfully deleted
I20260807 15:20:30.633677 27839 catalog_manager.cc:4841] TS d68c7327aaa848cbab9889c0e0626259 (127.15.242.195:41023): tablet 87756c683cae427d9cd521bba8dcd002 (table test-table [id=339b8e63a4ea417fbb1a8d992be8fb96]) successfully deleted
W20260807 15:20:30.641861 27841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:38287 (error 108)
I20260807 15:20:30.642203 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 28199
I20260807 15:20:30.651748 28860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:30.650746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38287 (local address 127.0.0.1:36988)
0807 15:20:30.651496 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:30.651605 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:38287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":494,"threads_started":1}
W20260807 15:20:30.652484 27841 catalog_manager.cc:4584] TS 3d24c694ec974700878d76d1cac31258 (127.15.242.193:38287): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 87756c683cae427d9cd521bba8dcd002: Network error: Client connection negotiation failed: client connection to 127.15.242.193:38287: connect: Connection refused (error 111)
I20260807 15:20:30.661149 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 28435
I20260807 15:20:30.678021 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 27813
2026-08-07T15:20:30Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4042 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:30 dist-test-slave-g170 krb5kdc[28863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:30 dist-test-slave-g170 krb5kdc[28863](info): set up 2 sockets
Aug 07 15:20:30 dist-test-slave-g170 krb5kdc[28863](info): commencing operation
krb5kdc: starting...
W20260807 15:20:31.931102 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:32 dist-test-slave-g170 krb5kdc[28863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:32.073017 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:42765
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:42765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:32.190303 28881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:32.190620 28881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:32.190701 28881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:32.194737 28881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:32.194824 28881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:32.194864 28881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:32.194922 28881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:32.194964 28881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:32.200248 28881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:42765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:42765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:32.201385 28881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:32.202425 28881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:32.211156 28891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:32.211220 28889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:32.211156 28894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:32.211535 28881 server_base.cc:1034] running on GCE node
I20260807 15:20:32.212054 28881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:32.213266 28881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:32.214442 28881 hybrid_clock.cc:648] HybridClock initialized: now 1786116032214419 us; error 33 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T15:20:32Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1542 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:32 dist-test-slave-g170 krb5kdc[28902](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:32 dist-test-slave-g170 krb5kdc[28902](info): set up 2 sockets
Aug 07 15:20:32 dist-test-slave-g170 krb5kdc[28902](info): commencing operation
krb5kdc: starting...
W20260807 15:20:33.509034 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:33 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:33.641340 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:36339
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:36339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:33.761334 28928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:33.761689 28928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:33.761773 28928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:33.767113 28928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:33.767225 28928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:33.767270 28928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:33.767305 28928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:33.767335 28928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:33.776489 28928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:36339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:36339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:33.777906 28928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:33.779070 28928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:33.788991 28941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:33.788991 28936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:33.789001 28937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:33.789194 28928 server_base.cc:1034] running on GCE node
I20260807 15:20:33.790143 28928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:33.791414 28928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:33.792613 28928 hybrid_clock.cc:648] HybridClock initialized: now 1786116033792594 us; error 43 us; skew 500 ppm
Aug 07 15:20:33 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:33.795660 28928 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:33.796648 28928 webserver.cc:460] Webserver started at http://127.15.242.254:44361/ using document root <none> and password file <none>
I20260807 15:20:33.797269 28928 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:33.797334 28928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:33.797511 28928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:33.799624 28928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a"
format_stamp: "Formatted at 2026-08-07 15:20:33 on dist-test-slave-g170"
server_key: "06a584d94ca6c901db4b262f944605c9"
server_key_iv: "dc4d17f2d248d5807d354e07228db918"
server_key_version: "encryptionkey@0"
I20260807 15:20:33.800141 28928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a"
format_stamp: "Formatted at 2026-08-07 15:20:33 on dist-test-slave-g170"
server_key: "06a584d94ca6c901db4b262f944605c9"
server_key_iv: "dc4d17f2d248d5807d354e07228db918"
server_key_version: "encryptionkey@0"
I20260807 15:20:33.804064 28928 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:20:33.806715 28952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:33.808183 28928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:33.808364 28928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a"
format_stamp: "Formatted at 2026-08-07 15:20:33 on dist-test-slave-g170"
server_key: "06a584d94ca6c901db4b262f944605c9"
server_key_iv: "dc4d17f2d248d5807d354e07228db918"
server_key_version: "encryptionkey@0"
I20260807 15:20:33.808482 28928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:33.847349 28928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:33.851336 28928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:33.851616 28928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:33.860209 28928 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:36339
I20260807 15:20:33.860237 29031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:36339 every 8 connection(s)
I20260807 15:20:33.861415 28928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:33.864367 29034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:33.870180 29034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Bootstrap starting.
I20260807 15:20:33.870384 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 28928
I20260807 15:20:33.870540 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:33.870903 16331 external_mini_cluster.cc:1428] Setting key 2c8faef3668ce32bf1610c05be6c2fe3
I20260807 15:20:33.873129 29034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:33.874069 29034 log.cc:824] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:33.876031 29034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: No bootstrap required, opened a new log
I20260807 15:20:33.879951 29034 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } }
I20260807 15:20:33.880261 29034 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:33.880316 29034 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a9c4826cdbc4f41a01c80af37c8bd9a, State: Initialized, Role: FOLLOWER
Aug 07 15:20:33 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:33.880892 29034 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } }
I20260807 15:20:33.881093 29034 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:33.881192 29034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:33.881326 29034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:33.882543 29034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } }
I20260807 15:20:33.882938 29034 leader_election.cc:302] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a9c4826cdbc4f41a01c80af37c8bd9a; no voters:
I20260807 15:20:33.883355 29034 leader_election.cc:288] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:33.883482 29045 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:33.883708 29045 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 1 LEADER]: Becoming Leader. State: Replica: 6a9c4826cdbc4f41a01c80af37c8bd9a, State: Running, Role: LEADER
I20260807 15:20:33.884049 29045 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } }
I20260807 15:20:33.884886 29034 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:33.885842 29047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a9c4826cdbc4f41a01c80af37c8bd9a. Latest consensus state: current_term: 1 leader_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } } }
I20260807 15:20:33.885975 29047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:33.886283 29046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } } }
I20260807 15:20:33.886387 29046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:33.886708 29060 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:33.887585 29039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:33.872405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53004 (local address 127.15.242.254:36339)
0807 15:20:33.872911 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:33.872931 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:33.872977 (+ 46us) server_negotiation.cc:407] Connection header received
0807 15:20:33.873900 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:33.873927 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:33.874361 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:33.874750 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:33.875578 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:33.876617 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:33.877528 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:33.878013 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:33.878203 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:33.881158 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:33.881167 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:33.881186 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:33.881225 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:33.883215 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:33.883786 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:33.883793 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:33.883799 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:33.883942 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:33.884288 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:33.884292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:33.884293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:33.884859 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:33.885782 (+ 923us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:33.885969 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 15:20:33.886331 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":150,"threads_started":1}
I20260807 15:20:33.890182 29060 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:33.896054 29060 catalog_manager.cc:1347] Generated new cluster ID: c2b799f1dce746dd923a57b5eba301d0
I20260807 15:20:33.896127 29060 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:33.921777 29060 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:33.922881 29060 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:33.930526 29060 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Generated new TSK 0
I20260807 15:20:33.931284 29060 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:20:33.976585 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:36339
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:34.117548 29081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:34.117808 29081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:34.117852 29081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:34.121928 29081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:34.121994 29081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:34.122079 29081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:34.127558 29081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:34.128664 29081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:34.129810 29081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:34.139889 29088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:34.139921 29092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:34.139932 29089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:34.140390 29081 server_base.cc:1034] running on GCE node
I20260807 15:20:34.140929 29081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:34.141670 29081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:34.142901 29081 hybrid_clock.cc:648] HybridClock initialized: now 1786116034142864 us; error 50 us; skew 500 ppm
Aug 07 15:20:34 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:34.146142 29081 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:20:34.147092 29081 webserver.cc:460] Webserver started at http://127.15.242.193:36355/ using document root <none> and password file <none>
I20260807 15:20:34.147758 29081 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:34.147867 29081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:34.148147 29081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:34.150353 29081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "57265f0929764b9dace6571839f1fa0a"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "16ecd72488eb8ec5f676b6acf96ec5f0"
server_key_iv: "7245c4606a75d75e1a56c086f760a547"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.150971 29081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "57265f0929764b9dace6571839f1fa0a"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "16ecd72488eb8ec5f676b6acf96ec5f0"
server_key_iv: "7245c4606a75d75e1a56c086f760a547"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.155189 29081 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:34.157848 29102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.159180 29081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:34.159343 29081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "57265f0929764b9dace6571839f1fa0a"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "16ecd72488eb8ec5f676b6acf96ec5f0"
server_key_iv: "7245c4606a75d75e1a56c086f760a547"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.159468 29081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:34.173712 29081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:34.177340 29081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:34.177577 29081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:34.178247 29081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:34.179188 29081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:34.179263 29081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.179337 29081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:34.179382 29081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.189316 29081 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:40777
I20260807 15:20:34.189350 29279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:40777 every 8 connection(s)
I20260807 15:20:34.190237 29081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:34.196276 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 29081
I20260807 15:20:34.196444 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:34.196750 16331 external_mini_cluster.cc:1428] Setting key 3cc6fd0ea2c1a4efdc5c9c86d344efda
Aug 07 15:20:34 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:34.205714 29039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:34.192292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:49731 (local address 127.15.242.254:36339)
0807 15:20:34.192440 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:34.192444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:34.193626 (+ 1182us) server_negotiation.cc:407] Connection header received
0807 15:20:34.194608 (+ 982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:34.194612 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:34.194671 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:34.194795 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:34.196009 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.196644 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.198175 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.198414 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.198525 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:34.201609 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:34.201613 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:34.201615 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:34.201641 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:34.203360 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:34.203972 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:34.203976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:34.203977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:34.204061 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:34.204458 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:34.204462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:34.204466 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:34.204662 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:34.204805 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:34.205369 (+ 564us) server_negotiation.cc:299] Negotiation successful
0807 15:20:34.205519 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 15:20:34.206574 29285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:34.192600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:49731)
0807 15:20:34.193476 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:34.193518 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:34.194398 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:34.194972 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:34.194979 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:34.195335 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:34.195830 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:34.195844 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.196790 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.196794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:34.197923 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:34.197934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.198580 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.198584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:34.198756 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:34.199385 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:34.199402 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:34.201413 (+ 2011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:34.203502 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:34.203509 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:34.203525 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:34.203837 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:34.204168 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:34.204172 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:34.204175 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:34.204338 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:34.204811 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:34.204821 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:34.205094 (+ 273us) client_negotiation.cc:769] Sending connection context
0807 15:20:34.205300 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 15:20:34.205652 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":192,"threads_started":1}
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:20:34.208017 29282 heartbeater.cc:347] Connected to a master server at 127.15.242.254:36339
I20260807 15:20:34.208340 29282 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:34.208956 29282 heartbeater.cc:511] Master 127.15.242.254:36339 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:20:34.210785 28980 ts_manager.cc:194] Registered new tserver with Master: 57265f0929764b9dace6571839f1fa0a (127.15.242.193:40777)
I20260807 15:20:34.211992 28980 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:49731
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:20:34.228273 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:36339
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:34.350735 29290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:34.350972 29290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:34.351015 29290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:34.355070 29290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:34.355129 29290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:34.355185 29290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:34.360284 29290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:34.361294 29290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:34.362249 29290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:34.371767 29299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:34.372006 29290 server_base.cc:1034] running on GCE node
W20260807 15:20:34.371768 29300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:34.372262 29302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:34.372730 29290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:34.373512 29290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:34.374740 29290 hybrid_clock.cc:648] HybridClock initialized: now 1786116034374714 us; error 39 us; skew 500 ppm
Aug 07 15:20:34 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:34.378439 29290 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:20:34.379601 29290 webserver.cc:460] Webserver started at http://127.15.242.194:45277/ using document root <none> and password file <none>
I20260807 15:20:34.380345 29290 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:34.380443 29290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:34.380690 29290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:34.383548 29290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "1d121827d01540b796df59a185c862d2"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "9a0645a53d7ffaccddfc8383d2f71cb4"
server_key_iv: "5b79fd3363fbd32254b52b93e52ffb4e"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.384254 29290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "1d121827d01540b796df59a185c862d2"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "9a0645a53d7ffaccddfc8383d2f71cb4"
server_key_iv: "5b79fd3363fbd32254b52b93e52ffb4e"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.389997 29290 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 15:20:34.392865 29310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.394208 29290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:34.394345 29290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "1d121827d01540b796df59a185c862d2"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "9a0645a53d7ffaccddfc8383d2f71cb4"
server_key_iv: "5b79fd3363fbd32254b52b93e52ffb4e"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.394472 29290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:34.439054 29290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:34.442950 29290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:34.443184 29290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:34.443866 29290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:34.444808 29290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:34.444885 29290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.444960 29290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:34.445005 29290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.455017 29290 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:35707
I20260807 15:20:34.455046 29485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:35707 every 8 connection(s)
I20260807 15:20:34.455983 29290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:34.456212 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 29290
I20260807 15:20:34.456341 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:34.456698 16331 external_mini_cluster.cc:1428] Setting key b02c6f8f1755d0e6f7d6a9a9f8dd369e
Aug 07 15:20:34 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:20:34.473625 29039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:34.458156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:48447 (local address 127.15.242.254:36339)
0807 15:20:34.458308 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:34.458313 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:34.459534 (+ 1221us) server_negotiation.cc:407] Connection header received
0807 15:20:34.460418 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:34.460424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:34.460492 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:34.460605 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:34.462348 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.463440 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.464954 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.465440 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.465592 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:34.468718 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:34.468723 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:34.468726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:34.468778 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:34.470715 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:34.471370 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:34.471378 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:34.471383 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:34.471552 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:34.472004 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:34.472011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:34.472015 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:34.472418 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:34.472531 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:34.473313 (+ 782us) server_negotiation.cc:299] Negotiation successful
0807 15:20:34.473450 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 15:20:34.474617 29490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:34.458622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:48447)
0807 15:20:34.459361 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:34.459415 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:34.460213 (+ 798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:34.460858 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:34.460869 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:34.461403 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:34.462131 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:34.462148 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.463680 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.463684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:34.464810 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:34.464828 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.465662 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.465666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:34.465824 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:34.466575 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:34.466603 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:34.468491 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:34.470867 (+ 2376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:34.470878 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:34.470901 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:34.471239 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:34.471711 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:34.471714 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:34.471716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:34.471906 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:34.472531 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:34.472539 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:34.472999 (+ 460us) client_negotiation.cc:769] Sending connection context
0807 15:20:34.473259 (+ 260us) client_negotiation.cc:240] Negotiation successful
0807 15:20:34.473612 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":134,"threads_started":1}
I20260807 15:20:34.475943 29486 heartbeater.cc:347] Connected to a master server at 127.15.242.254:36339
I20260807 15:20:34.476238 29486 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:34.476820 29486 heartbeater.cc:511] Master 127.15.242.254:36339 requested a full tablet report, sending...
I20260807 15:20:34.478039 28980 ts_manager.cc:194] Registered new tserver with Master: 1d121827d01540b796df59a185c862d2 (127.15.242.194:35707)
I20260807 15:20:34.479097 28980 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:48447
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:20:34.493875 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:36339
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:34.613780 29494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:34.614049 29494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:34.614095 29494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:34.618247 29494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:34.618330 29494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:34.618433 29494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:34.623723 29494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:34.624897 29494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:34.625970 29494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:20:34.636114 29494 server_base.cc:1034] running on GCE node
W20260807 15:20:34.636059 29501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:34.636096 29508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:34.636063 29502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:34.637084 29494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:34.637837 29494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:34.639039 29494 hybrid_clock.cc:648] HybridClock initialized: now 1786116034639013 us; error 42 us; skew 500 ppm
Aug 07 15:20:34 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:34.642015 29494 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:20:34.642866 29494 webserver.cc:460] Webserver started at http://127.15.242.195:33029/ using document root <none> and password file <none>
I20260807 15:20:34.643445 29494 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:34.643539 29494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:34.643787 29494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:34.645884 29494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "12422a0ac0a34505904f7071d1e8a363"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "bf19337a2c76ef7a75e25a9d489b30bf"
server_key_iv: "64149f202da82ed2c2572eeac474b5d2"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.646435 29494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "12422a0ac0a34505904f7071d1e8a363"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "bf19337a2c76ef7a75e25a9d489b30bf"
server_key_iv: "64149f202da82ed2c2572eeac474b5d2"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.650609 29494 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 15:20:34.653159 29515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.654456 29494 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 15:20:34.654613 29494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "12422a0ac0a34505904f7071d1e8a363"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "bf19337a2c76ef7a75e25a9d489b30bf"
server_key_iv: "64149f202da82ed2c2572eeac474b5d2"
server_key_version: "encryptionkey@0"
I20260807 15:20:34.654798 29494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:34.677922 29494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:34.681496 29494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:34.681744 29494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:34.682425 29494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:34.683377 29494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:34.683456 29494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.683537 29494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:34.683629 29494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:34.694242 29494 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:46813
I20260807 15:20:34.694258 29693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:46813 every 8 connection(s)
I20260807 15:20:34.695245 29494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:34.701848 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 29494
I20260807 15:20:34.702023 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:34.702328 16331 external_mini_cluster.cc:1428] Setting key 95331950065cc5505fc870b762b11a95
Aug 07 15:20:34 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:34.710309 29039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:34.697428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:35277 (local address 127.15.242.254:36339)
0807 15:20:34.697577 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:34.697581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:34.698753 (+ 1172us) server_negotiation.cc:407] Connection header received
0807 15:20:34.699728 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:34.699731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:34.699787 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:34.699901 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:34.701502 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.702238 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.703670 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.703924 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.704045 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:34.706920 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:34.706923 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:34.706925 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:34.706949 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:34.708353 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:34.708980 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:34.708983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:34.708985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:34.709063 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:34.709382 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:34.709384 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:34.709385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:34.709553 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:34.709627 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:34.710086 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 15:20:34.710190 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:20:34.711081 29697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:34.697897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:35277)
0807 15:20:34.698585 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:34.698629 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:34.699514 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:34.700084 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:34.700091 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:34.700458 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:34.701329 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:34.701345 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.702413 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.702420 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:34.703515 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:34.703527 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:34.704091 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:34.704095 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:34.704336 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:34.705027 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:34.705046 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:34.706658 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:34.708487 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:34.708492 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:34.708504 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:34.708876 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:34.709148 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:34.709151 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:34.709152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:34.709291 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:34.709654 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:34.709659 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:34.709873 (+ 214us) client_negotiation.cc:769] Sending connection context
0807 15:20:34.710018 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 15:20:34.710259 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":108,"threads_started":1}
I20260807 15:20:34.712245 29695 heartbeater.cc:347] Connected to a master server at 127.15.242.254:36339
I20260807 15:20:34.712518 29695 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:34.713130 29695 heartbeater.cc:511] Master 127.15.242.254:36339 requested a full tablet report, sending...
I20260807 15:20:34.714174 28980 ts_manager.cc:194] Registered new tserver with Master: 12422a0ac0a34505904f7071d1e8a363 (127.15.242.195:46813)
I20260807 15:20:34.714766 28980 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:35277
I20260807 15:20:34.716153 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab.
Entry for principal oryx/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab.
WARNING: no policy specified for oryx/127.15.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab.
Entry for principal oryx/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab.
WARNING: no policy specified for oryx/127.15.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab.
Entry for principal oryx/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab.
I20260807 15:20:34.801069 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 29081
I20260807 15:20:34.822129 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 29290
I20260807 15:20:34.835453 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 29494
I20260807 15:20:34.849870 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 28928
I20260807 15:20:34.864547 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:36339
--webserver_interface=127.15.242.254
--webserver_port=44361
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:36339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:34.987313 29707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:34.987609 29707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:34.987650 29707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:34.991775 29707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:34.991835 29707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:34.991854 29707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:34.991871 29707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:34.991886 29707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:34.997107 29707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:36339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:36339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=44361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:34.998142 29707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:34.999168 29707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:35.008361 29713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:35.008384 29716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:35.008538 29707 server_base.cc:1034] running on GCE node
W20260807 15:20:35.008688 29714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:35.009331 29707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:35.010524 29707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:35.011865 29707 hybrid_clock.cc:648] HybridClock initialized: now 1786116035011852 us; error 32 us; skew 500 ppm
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:35.014909 29707 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:35.015897 29707 webserver.cc:460] Webserver started at http://127.15.242.254:44361/ using document root <none> and password file <none>
I20260807 15:20:35.016495 29707 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:35.016618 29707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:35.020874 29707 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:20:35.023252 29727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.024616 29707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:35.024857 29707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a"
format_stamp: "Formatted at 2026-08-07 15:20:33 on dist-test-slave-g170"
server_key: "06a584d94ca6c901db4b262f944605c9"
server_key_iv: "dc4d17f2d248d5807d354e07228db918"
server_key_version: "encryptionkey@0"
I20260807 15:20:35.025452 29707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:35.045497 29707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:35.048481 29707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:35.048691 29707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:35.056209 29707 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:36339
I20260807 15:20:35.056247 29807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:36339 every 8 connection(s)
I20260807 15:20:35.057303 29707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:35.061719 29812 sys_catalog.cc:263] Verifying existing consensus state
I20260807 15:20:35.063045 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 29707
I20260807 15:20:35.063469 29812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Bootstrap starting.
I20260807 15:20:35.063498 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:40777
--local_ip_for_outbound_sockets=127.15.242.193
--tserver_master_addrs=127.15.242.254:36339
--webserver_port=36355
--webserver_interface=127.15.242.193
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.242.193
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:20:35.081290 29812 log.cc:824] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:35.088225 29812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:20:35.088641 29812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Bootstrap complete.
I20260807 15:20:35.093099 29812 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } }
I20260807 15:20:35.093538 29812 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a9c4826cdbc4f41a01c80af37c8bd9a, State: Initialized, Role: FOLLOWER
I20260807 15:20:35.094033 29812 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } }
I20260807 15:20:35.094182 29812 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:35.094273 29812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:35.094398 29812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:20:35.096328 29812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } }
I20260807 15:20:35.096689 29812 leader_election.cc:302] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a9c4826cdbc4f41a01c80af37c8bd9a; no voters:
I20260807 15:20:35.097110 29812 leader_election.cc:288] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 15:20:35.097199 29821 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:20:35.097417 29821 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [term 2 LEADER]: Becoming Leader. State: Replica: 6a9c4826cdbc4f41a01c80af37c8bd9a, State: Running, Role: LEADER
I20260807 15:20:35.097716 29821 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } }
I20260807 15:20:35.098400 29812 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:35.099294 29830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a9c4826cdbc4f41a01c80af37c8bd9a. Latest consensus state: current_term: 2 leader_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } } }
I20260807 15:20:35.099426 29830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:35.099692 29824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9c4826cdbc4f41a01c80af37c8bd9a" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 36339 } } }
I20260807 15:20:35.099781 29824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:35.103611 29844 catalog_manager.cc:1259] Loaded cluster ID: c2b799f1dce746dd923a57b5eba301d0
I20260807 15:20:35.103674 29844 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: loading cluster ID for follower catalog manager: success
I20260807 15:20:35.106137 29844 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: acquiring CA information for follower catalog manager: success
I20260807 15:20:35.107532 29844 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 15:20:35.107654 29838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:35.108507 29838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:35.109004 29838 catalog_manager.cc:1259] Loaded cluster ID: c2b799f1dce746dd923a57b5eba301d0
I20260807 15:20:35.109063 29838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:35.109704 29838 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:35.110180 29838 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6a9c4826cdbc4f41a01c80af37c8bd9a: Loaded TSK: 0
I20260807 15:20:35.110922 29838 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 15:20:35.185078 29817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:35.185359 29817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:35.185429 29817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:35.189674 29817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:35.189766 29817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:35.189854 29817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:35.195151 29817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.193.keytab
--principal=oryx/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:40777
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=36355
--tserver_master_addrs=127.15.242.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:35.196187 29817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:35.197284 29817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:35.207895 29855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:35.207964 29853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:35.207966 29852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:35.209306 29817 server_base.cc:1034] running on GCE node
I20260807 15:20:35.209759 29817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:35.210491 29817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:35.211683 29817 hybrid_clock.cc:648] HybridClock initialized: now 1786116035211653 us; error 46 us; skew 500 ppm
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116035, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:35.214737 29817 init.cc:377] Logged in from keytab as oryx/127.15.242.193@KRBTEST.COM (short username oryx)
I20260807 15:20:35.215680 29817 webserver.cc:460] Webserver started at http://127.15.242.193:36355/ using document root <none> and password file <none>
I20260807 15:20:35.216290 29817 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:35.216413 29817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:35.220742 29817 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260807 15:20:35.222990 29864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.224323 29817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 15:20:35.224460 29817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "57265f0929764b9dace6571839f1fa0a"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "16ecd72488eb8ec5f676b6acf96ec5f0"
server_key_iv: "7245c4606a75d75e1a56c086f760a547"
server_key_version: "encryptionkey@0"
I20260807 15:20:35.225069 29817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:35.249042 29817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:35.252118 29817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:35.252339 29817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:35.252985 29817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:35.253845 29817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:35.253921 29817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.253988 29817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:35.254040 29817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.263285 29817 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:40777
I20260807 15:20:35.263312 30028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:40777 every 8 connection(s)
I20260807 15:20:35.264286 29817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:35.271473 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 29817
I20260807 15:20:35.272053 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:35707
--local_ip_for_outbound_sockets=127.15.242.194
--tserver_master_addrs=127.15.242.254:36339
--webserver_port=45277
--webserver_interface=127.15.242.194
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.242.194
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:35.277930 30034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.266532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:53923)
0807 15:20:35.267283 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.267336 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.268195 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.269299 (+ 1104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.269305 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.269646 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.270116 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.270129 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.271391 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.271394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.272873 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.272889 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.273648 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.273655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.273887 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.274547 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.274563 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.277186 (+ 2623us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":152,"threads_started":1}
W20260807 15:20:35.278491 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.266393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:53923 (local address 127.15.242.254:36339)
0807 15:20:35.266868 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.266893 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.267455 (+ 562us) server_negotiation.cc:407] Connection header received
0807 15:20:35.268562 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.268574 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.268916 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.269199 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.270268 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.271251 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.273002 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.273480 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.273602 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.277483 (+ 3881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:53923: BlockingRecv error: recv got EOF from 127.15.242.193:53923 (error 108)
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":123,"threads_started":1}
W20260807 15:20:35.278559 30029 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:36339 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.242.254:36339: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:35.284389 30034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.279123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:34029)
0807 15:20:35.279229 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.279248 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.279341 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.279576 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.279580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.279738 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.279830 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.279835 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.280553 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.280557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.281144 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.281152 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.281625 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.281628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.281720 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.282217 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.282244 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.284249 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 15:20:35.284482 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.279224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:34029 (local address 127.15.242.254:36339)
0807 15:20:35.279359 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.279366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.279381 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:20:35.279419 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.279422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.279469 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.279560 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.279944 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.280444 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.281293 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.281511 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.281621 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.284372 (+ 2751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:34029: BlockingRecv error: recv got EOF from 127.15.242.193:34029 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:35.289915 30034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.284916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:54129)
0807 15:20:35.285027 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.285042 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.285113 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.285332 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.285334 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.285449 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.285517 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.285521 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.286492 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.286495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.287005 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.287013 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.287562 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.287565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.287623 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.288097 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.288108 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.289830 (+ 1722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 15:20:35.290091 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.284939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:54129 (local address 127.15.242.254:36339)
0807 15:20:35.285098 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.285102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.285116 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:35.285180 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.285183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.285223 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.285306 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.285616 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.286387 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.287110 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.287455 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.287552 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.289984 (+ 2432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:54129: BlockingRecv error: recv got EOF from 127.15.242.193:54129 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260807 15:20:35.290289 30029 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 15:20:35.393128 30035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:35.393440 30035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:35.393513 30035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:35.397766 30035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:35.397859 30035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:35.397990 30035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:35.403673 30035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.194.keytab
--principal=oryx/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:35707
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=45277
--tserver_master_addrs=127.15.242.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:35.404892 30035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:35.405972 30035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:35.416417 30043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:35.416417 30046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:35.416448 30044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:35.416754 30035 server_base.cc:1034] running on GCE node
I20260807 15:20:35.417366 30035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:35.418176 30035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:35.419409 30035 hybrid_clock.cc:648] HybridClock initialized: now 1786116035419319 us; error 109 us; skew 500 ppm
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116035, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:35.422569 30035 init.cc:377] Logged in from keytab as oryx/127.15.242.194@KRBTEST.COM (short username oryx)
I20260807 15:20:35.423692 30035 webserver.cc:460] Webserver started at http://127.15.242.194:45277/ using document root <none> and password file <none>
I20260807 15:20:35.424342 30035 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:35.424474 30035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:35.429322 30035 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:35.431715 30057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.433214 30035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:35.433375 30035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "1d121827d01540b796df59a185c862d2"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "9a0645a53d7ffaccddfc8383d2f71cb4"
server_key_iv: "5b79fd3363fbd32254b52b93e52ffb4e"
server_key_version: "encryptionkey@0"
I20260807 15:20:35.433980 30035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:35.449587 30035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:35.452875 30035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:35.453104 30035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:35.453797 30035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:35.454697 30035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:35.454785 30035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.454859 30035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:35.454916 30035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.464926 30035 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:35707
I20260807 15:20:35.464974 30219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:35707 every 8 connection(s)
I20260807 15:20:35.466001 30035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:35.470580 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 30035
I20260807 15:20:35.471043 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:46813
--local_ip_for_outbound_sockets=127.15.242.195
--tserver_master_addrs=127.15.242.254:36339
--webserver_port=33029
--webserver_interface=127.15.242.195
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.242.195
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 15:20:35.478628 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.467826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:53417 (local address 127.15.242.254:36339)
0807 15:20:35.467986 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.467990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.469186 (+ 1196us) server_negotiation.cc:407] Connection header received
0807 15:20:35.470206 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.470210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.470273 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.470359 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.471730 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.472279 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.474091 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.474344 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.474437 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.478503 (+ 4066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:53417: BlockingRecv error: recv got EOF from 127.15.242.194:53417 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 15:20:35.479239 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.468211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:53417)
0807 15:20:35.468997 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.469042 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.469969 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.470560 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.470567 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.470991 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.471561 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.471576 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.472417 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.472422 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.473919 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.473935 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.474521 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.474528 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.474771 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.475480 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.475505 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.478382 (+ 2877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":107,"threads_started":1}
W20260807 15:20:35.479707 30221 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:36339 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.242.254:36339: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:35.486371 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.480228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:34173)
0807 15:20:35.480406 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.480423 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.480515 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.480877 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.480879 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.481014 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.481113 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.481118 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.482301 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.482304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.482949 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.482958 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.483622 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.483625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.483700 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.484282 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.484295 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.486236 (+ 1941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":91}
W20260807 15:20:35.486531 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.480372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:34173 (local address 127.15.242.254:36339)
0807 15:20:35.480531 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.480537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.480556 (+ 19us) server_negotiation.cc:407] Connection header received
0807 15:20:35.480607 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.480613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.480682 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.480815 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.481241 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.482153 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.483083 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.483490 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.483640 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.486373 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:34173: BlockingRecv error: recv got EOF from 127.15.242.194:34173 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:35.492614 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.487098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:42339)
0807 15:20:35.487254 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.487268 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.487337 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.487559 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.487562 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.487732 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.487822 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.487831 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.488572 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.488575 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.489454 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.489466 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.489944 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.489947 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.490035 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.490489 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.490503 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.492485 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":94}
W20260807 15:20:35.492810 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.487207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:42339 (local address 127.15.242.254:36339)
0807 15:20:35.487348 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.487352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.487387 (+ 35us) server_negotiation.cc:407] Connection header received
0807 15:20:35.487420 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.487422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.487457 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.487519 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.487943 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.488466 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.489596 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.489832 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.489921 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.492609 (+ 2688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:42339: BlockingRecv error: recv got EOF from 127.15.242.194:42339 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 15:20:35.492940 30221 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 15:20:35.591270 30230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:35.591509 30230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:35.591552 30230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:35.595531 30230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:35.595589 30230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:35.595695 30230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:35.601193 30230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/krb5kdc/oryx_127.15.242.195.keytab
--principal=oryx/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:46813
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=33029
--tserver_master_addrs=127.15.242.254:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:35.602214 30230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:35.603169 30230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:35.613160 30237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:35.613387 30238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:35.613158 30241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:35.613500 30230 server_base.cc:1034] running on GCE node
I20260807 15:20:35.614024 30230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:35.614619 30230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:35.615772 30230 hybrid_clock.cc:648] HybridClock initialized: now 1786116035615741 us; error 44 us; skew 500 ppm
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116035, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:35.618623 30230 init.cc:377] Logged in from keytab as oryx/127.15.242.195@KRBTEST.COM (short username oryx)
I20260807 15:20:35.619524 30230 webserver.cc:460] Webserver started at http://127.15.242.195:33029/ using document root <none> and password file <none>
I20260807 15:20:35.620040 30230 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:35.620113 30230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:35.623929 30230 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:35.625984 30250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.627178 30230 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 15:20:35.627301 30230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "12422a0ac0a34505904f7071d1e8a363"
format_stamp: "Formatted at 2026-08-07 15:20:34 on dist-test-slave-g170"
server_key: "bf19337a2c76ef7a75e25a9d489b30bf"
server_key_iv: "64149f202da82ed2c2572eeac474b5d2"
server_key_version: "encryptionkey@0"
I20260807 15:20:35.627854 30230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:35.639846 30230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:35.642891 30230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:35.643051 30230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:35.643589 30230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:35.644381 30230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:35.644428 30230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.644466 30230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:35.644482 30230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:35.653558 30230 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:46813
I20260807 15:20:35.653743 30424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:46813 every 8 connection(s)
I20260807 15:20:35.654623 30230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:35.659192 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 30230
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 15:20:35.667407 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.656573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:34277 (local address 127.15.242.254:36339)
0807 15:20:35.656827 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.656832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.657773 (+ 941us) server_negotiation.cc:407] Connection header received
0807 15:20:35.658731 (+ 958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.658735 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.658798 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.658906 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.660496 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.661500 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.663066 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.663403 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.663518 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.667282 (+ 3764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:34277: BlockingRecv error: recv got EOF from 127.15.242.195:34277 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
I20260807 15:20:35.668161 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.656932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:34277)
0807 15:20:35.657600 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.657647 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.658513 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.659093 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.659100 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.659547 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.660265 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.660282 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.661659 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.661663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.662940 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.662950 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.663581 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.663584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.663812 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.664498 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.664514 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.667170 (+ 2656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":114,"threads_started":1}
W20260807 15:20:35.668723 30425 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:36339 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.242.254:36339: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
I20260807 15:20:35.670316 30432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.660221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53020 (local address 127.15.242.254:36339)
0807 15:20:35.660514 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.660517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.660528 (+ 11us) server_negotiation.cc:407] Connection header received
0807 15:20:35.660559 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.660561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.660595 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.660678 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.661779 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.662575 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.663735 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.664091 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.664189 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.665818 (+ 1629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:35.665823 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:35.665841 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:35.665867 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:35.667750 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:35.668281 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:35.668290 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:35.668299 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:35.668473 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:35.668818 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:35.668821 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:35.668823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:35.669303 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:35.669481 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:35.669922 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 15:20:35.670198 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":98,"threads_started":1}
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:35.674906 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.669206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:37131)
0807 15:20:35.669358 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.669375 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.669460 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.669771 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.669775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.669952 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.670082 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.670089 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.670925 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.670930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.671717 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.671728 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.672330 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.672333 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.672437 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.673006 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.673017 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.674766 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":74}
W20260807 15:20:35.674996 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.669327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:37131 (local address 127.15.242.254:36339)
0807 15:20:35.669440 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.669444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.669457 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:20:35.669574 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.669577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.669622 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.669698 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.670211 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.670814 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.671857 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.672185 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.672313 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.674877 (+ 2564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:37131: BlockingRecv error: recv got EOF from 127.15.242.195:37131 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:35 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:35.680506 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:35.675500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:39911)
0807 15:20:35.675668 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:35.675686 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:35.675799 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:35.676059 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:35.676062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:35.676228 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:35.676302 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.676307 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.677082 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.677086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.677601 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:35.677609 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.678054 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.678057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:35.678140 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.678572 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:35.678583 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:35.680351 (+ 1768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260807 15:20:35.680591 30031 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:35.675606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:39911 (local address 127.15.242.254:36339)
0807 15:20:35.675768 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:35.675772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:35.675786 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:35.675910 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:35.675913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:35.675958 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:35.676041 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:35.676416 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.676973 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.677730 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:35.677943 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:35.678051 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:35.680472 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:39911: BlockingRecv error: recv got EOF from 127.15.242.195:39911 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260807 15:20:35.680904 30425 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 15:20:36 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:36 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:36.296958 30433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:36.290993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:44949)
0807 15:20:36.291342 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:36.291359 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:36.291479 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:36.291776 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:36.291779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:36.291992 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:36.292112 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:36.292118 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.293005 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.293009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:36.293591 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:36.293599 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.294095 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.294099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:36.294195 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:36.294759 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:36.294771 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:36.296831 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":104,"threads_started":1}
W20260807 15:20:36.297164 30435 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:36.291105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:44949 (local address 127.15.242.254:36339)
0807 15:20:36.291383 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:36.291390 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:36.291410 (+ 20us) server_negotiation.cc:407] Connection header received
0807 15:20:36.291596 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:36.291599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:36.291652 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:36.291747 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:36.292250 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.292892 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.293721 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.293978 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.294091 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:36.296984 (+ 2893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:44949: BlockingRecv error: recv got EOF from 127.15.242.193:44949 (error 108)
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":104,"threads_started":1}
Aug 07 15:20:36 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:36 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:36.505443 30436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:36.493598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:41985)
0807 15:20:36.493903 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:36.493924 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:36.494054 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:36.494341 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:36.494344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:36.494565 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:36.494688 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:36.494694 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.495475 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.495480 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:36.496062 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:36.496070 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.496537 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.496540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:36.496642 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:36.503087 (+ 6445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:36.503103 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:36.505325 (+ 2222us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":96,"threads_started":1}
W20260807 15:20:36.505686 30435 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:36.493668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:41985 (local address 127.15.242.254:36339)
0807 15:20:36.493849 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:36.493854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:36.494002 (+ 148us) server_negotiation.cc:407] Connection header received
0807 15:20:36.494165 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:36.494169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:36.494223 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:36.494314 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:36.494829 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.495360 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.496189 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.496421 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.496532 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:36.505505 (+ 8973us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:41985: BlockingRecv error: recv got EOF from 127.15.242.194:41985 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 07 15:20:36 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:36 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:36.687533 30439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:36.681547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:42387)
0807 15:20:36.681884 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:36.681897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:36.682008 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:36.682277 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:36.682280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:36.682471 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:36.682593 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:36.682598 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.683458 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.683461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:36.684092 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:36.684102 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.684551 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.684554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:36.684628 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:36.685431 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:36.685445 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:36.687416 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":154,"threads_started":1}
W20260807 15:20:36.687780 30435 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:36.681635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:42387 (local address 127.15.242.254:36339)
0807 15:20:36.681789 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:36.681793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:36.681998 (+ 205us) server_negotiation.cc:407] Connection header received
0807 15:20:36.682086 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:36.682088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:36.682145 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:36.682219 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:36.682814 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.683336 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.684217 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:36.684441 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:36.684523 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:36.687599 (+ 3076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:42387: BlockingRecv error: recv got EOF from 127.15.242.195:42387 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 15:20:37 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:37 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:37.310058 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:37.297761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:42747)
0807 15:20:37.298081 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:37.298094 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:37.298189 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:37.298465 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:37.298468 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:37.298697 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:37.298867 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:37.298884 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.299843 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.299846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:37.300397 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:37.300406 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.301005 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.301008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:37.301073 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:37.307757 (+ 6684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:37.307772 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:37.309867 (+ 2095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":122,"threads_started":1}
W20260807 15:20:37.310153 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:37.297870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:42747 (local address 127.15.242.254:36339)
0807 15:20:37.298153 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:37.298157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:37.298172 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:20:37.298278 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:37.298280 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:37.298337 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:37.298428 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:37.298999 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.299711 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.300528 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.300880 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.300977 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:37.310003 (+ 9026us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:42747: BlockingRecv error: recv got EOF from 127.15.242.193:42747 (error 108)
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":118,"threads_started":1}
Aug 07 15:20:37 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:37 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:37.512071 30444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:37.506321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:54429)
0807 15:20:37.506595 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:37.506608 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:37.506751 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:37.506992 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:37.506994 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:37.507192 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:37.507301 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:37.507307 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.508235 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.508239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:37.508983 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:37.508996 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.509465 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.509469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:37.509553 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:37.510056 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:37.510068 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:37.511889 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
W20260807 15:20:37.512128 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:37.506368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:54429 (local address 127.15.242.254:36339)
0807 15:20:37.506520 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:37.506525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:37.506679 (+ 154us) server_negotiation.cc:407] Connection header received
0807 15:20:37.506835 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:37.506837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:37.506884 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:37.506953 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:37.507429 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.508104 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.509104 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.509341 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.509454 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:37.512020 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:54429: BlockingRecv error: recv got EOF from 127.15.242.194:54429 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 15:20:37 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:37 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:37.694373 30445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:37.688435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:36435)
0807 15:20:37.688813 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:37.688832 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:37.688957 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:37.689272 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:37.689275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:37.689488 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:37.689590 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:37.689595 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.690372 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.690378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:37.690938 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:37.690946 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.691418 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.691421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:37.691509 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:37.692011 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:37.692022 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:37.694194 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":108,"threads_started":1}
W20260807 15:20:37.694571 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:37.688619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:36435 (local address 127.15.242.254:36339)
0807 15:20:37.688878 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:37.688884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:37.688900 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:20:37.689082 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:37.689085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:37.689140 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:37.689227 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:37.689727 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.690262 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.691068 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:37.691298 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:37.691412 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:37.694442 (+ 3030us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:36435: BlockingRecv error: recv got EOF from 127.15.242.195:36435 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 07 15:20:38 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:38 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:38.317358 30449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:38.310969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:44459)
0807 15:20:38.311293 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:38.311311 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:38.311437 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:38.311935 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:38.311941 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:38.312269 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:38.312416 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:38.312425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.313347 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.313351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:38.313958 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:38.313968 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.314437 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.314439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:38.314505 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:38.315027 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:38.315040 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:38.317206 (+ 2166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":75,"threads_started":1}
W20260807 15:20:38.317528 30452 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:38.311022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:44459 (local address 127.15.242.254:36339)
0807 15:20:38.311332 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:38.311339 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:38.311381 (+ 42us) server_negotiation.cc:407] Connection header received
0807 15:20:38.311619 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:38.311623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:38.311757 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:38.311840 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:38.312589 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.313238 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.314084 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.314328 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.314415 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:38.317369 (+ 2954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:44459: BlockingRecv error: recv got EOF from 127.15.242.193:44459 (error 108)
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":102,"threads_started":1}
Aug 07 15:20:38 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:38 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:38.519946 30453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:38.513199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:42915)
0807 15:20:38.513578 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:38.513601 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:38.513709 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:38.514020 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:38.514024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:38.514283 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:38.514398 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:38.514405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.515297 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.515303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:38.515971 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:38.515981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.516537 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.516542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:38.516657 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:38.517385 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:38.517400 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:38.519722 (+ 2322us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":131,"threads_started":1}
W20260807 15:20:38.520021 30452 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:38.513284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:42915 (local address 127.15.242.254:36339)
0807 15:20:38.513480 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:38.513487 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:38.513699 (+ 212us) server_negotiation.cc:407] Connection header received
0807 15:20:38.513797 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:38.513802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:38.513870 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:38.513986 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:38.514551 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.515158 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.516129 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.516397 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.516533 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:38.519882 (+ 3349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:42915: BlockingRecv error: recv got EOF from 127.15.242.194:42915 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 15:20:38 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:38 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:38.701186 30458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:38.695218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:54173)
0807 15:20:38.695535 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:38.695550 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:38.695652 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:38.695876 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:38.695879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:38.696068 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:38.696166 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:38.696171 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.697125 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.697130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:38.697801 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:38.697813 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.698260 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.698263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:38.698342 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:38.698950 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:38.698962 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:38.701049 (+ 2087us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":120,"threads_started":1}
W20260807 15:20:38.701354 30452 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:38.695302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:54173 (local address 127.15.242.254:36339)
0807 15:20:38.695469 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:38.695477 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:38.695665 (+ 188us) server_negotiation.cc:407] Connection header received
0807 15:20:38.695713 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:38.695715 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:38.695764 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:38.695836 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:38.696266 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.696952 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.697927 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:38.698157 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:38.698238 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:38.701183 (+ 2945us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:54173: BlockingRecv error: recv got EOF from 127.15.242.195:54173 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 15:20:39 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:39 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:39.324050 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:39.318281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:45617)
0807 15:20:39.318607 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:39.318627 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:39.318721 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:39.318967 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:39.318969 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:39.319157 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:39.319281 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:39.319287 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.320138 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.320141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:39.320705 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:39.320714 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.321279 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.321282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:39.321350 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:39.321856 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:39.321868 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:39.323921 (+ 2053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":109,"threads_started":1}
W20260807 15:20:39.324302 30462 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:39.318425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:45617 (local address 127.15.242.254:36339)
0807 15:20:39.318712 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:39.318716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:39.318730 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:39.318790 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:39.318792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:39.318836 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:39.318926 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:39.319417 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.320029 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.320887 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.321157 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.321251 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:39.324149 (+ 2898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:45617: BlockingRecv error: recv got EOF from 127.15.242.193:45617 (error 108)
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":81,"threads_started":1}
Aug 07 15:20:39 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:39 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:39.527807 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:39.520932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:55397)
0807 15:20:39.521248 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:39.521264 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:39.521417 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:39.521793 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:39.521797 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:39.522046 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:39.522171 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:39.522179 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.523029 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.523035 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:39.523665 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:39.523673 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.524269 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.524275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:39.524432 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:39.525229 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:39.525242 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:39.527577 (+ 2335us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":88,"threads_started":1}
W20260807 15:20:39.527825 30462 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:39.520995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:55397 (local address 127.15.242.254:36339)
0807 15:20:39.521205 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:39.521211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:39.521360 (+ 149us) server_negotiation.cc:407] Connection header received
0807 15:20:39.521541 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:39.521544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:39.521656 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:39.521764 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:39.522311 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.522902 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.523823 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.524075 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.524221 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:39.527719 (+ 3498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:55397: BlockingRecv error: recv got EOF from 127.15.242.194:55397 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 07 15:20:39 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:39 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:39.708256 30464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:39.702091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:55559)
0807 15:20:39.702396 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:39.702409 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:39.702512 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:39.702900 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:39.702906 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:39.703157 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:39.703324 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:39.703331 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.704416 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.704419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:39.705026 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:39.705035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.705548 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.705551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:39.705621 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:39.706170 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:39.706188 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:39.708122 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":101,"threads_started":1}
W20260807 15:20:39.708454 30462 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:39.702154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:55559 (local address 127.15.242.254:36339)
0807 15:20:39.702298 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:39.702302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:39.702500 (+ 198us) server_negotiation.cc:407] Connection header received
0807 15:20:39.702622 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:39.702625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:39.702736 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:39.702830 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:39.703475 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.704280 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.705165 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:39.705411 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:39.705510 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:39.708285 (+ 2775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:55559: BlockingRecv error: recv got EOF from 127.15.242.195:55559 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 15:20:40 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:40 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:40.331254 30466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:40.324983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:37325)
0807 15:20:40.325338 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:40.325356 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:40.325504 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:40.325798 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:40.325801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:40.326029 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:40.326126 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:40.326132 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.326956 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.326962 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:40.327578 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:40.327587 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.328079 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.328083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:40.328169 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:40.328867 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:40.328880 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:40.331135 (+ 2255us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":127,"threads_started":1}
W20260807 15:20:40.331571 30469 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:40.325044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:37325 (local address 127.15.242.254:36339)
0807 15:20:40.325338 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:40.325344 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:40.325436 (+ 92us) server_negotiation.cc:407] Connection header received
0807 15:20:40.325606 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:40.325611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:40.325663 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:40.325765 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:40.326247 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.326832 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.327709 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.327954 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.328063 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:40.331425 (+ 3362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:37325: BlockingRecv error: recv got EOF from 127.15.242.193:37325 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":94,"threads_started":1}
Aug 07 15:20:40 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:40 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:40.535771 30470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:40.528946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:33897)
0807 15:20:40.529365 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:40.529381 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:40.529491 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:40.529788 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:40.529791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:40.530056 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:40.530191 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:40.530198 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.531163 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.531167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:40.531988 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:40.532000 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.532616 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.532619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:40.532786 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:40.533335 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:40.533347 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:40.535594 (+ 2247us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":139,"threads_started":1}
W20260807 15:20:40.535938 30469 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:40.529117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:33897 (local address 127.15.242.254:36339)
0807 15:20:40.529291 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:40.529295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:40.529481 (+ 186us) server_negotiation.cc:407] Connection header received
0807 15:20:40.529563 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:40.529565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:40.529658 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:40.529736 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:40.530362 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.530969 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.532142 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.532442 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.532597 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:40.535769 (+ 3172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:33897: BlockingRecv error: recv got EOF from 127.15.242.194:33897 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 15:20:40 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:40 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:40.715005 30472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:40.709136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:45557)
0807 15:20:40.709458 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:40.709472 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:40.709573 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:40.709874 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:40.709878 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:40.710073 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:40.710179 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:40.710185 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.711017 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.711021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:40.711646 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:40.711655 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.712077 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.712079 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:40.712158 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:40.712811 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:40.712832 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:40.714885 (+ 2053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":102,"threads_started":1}
W20260807 15:20:40.715152 30469 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:40.709267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:45557 (local address 127.15.242.254:36339)
0807 15:20:40.709467 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:40.709471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:40.709549 (+ 78us) server_negotiation.cc:407] Connection header received
0807 15:20:40.709669 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:40.709673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:40.709725 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:40.709803 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:40.710316 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.710896 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.711758 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:40.711975 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:40.712051 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:40.715027 (+ 2976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:45557: BlockingRecv error: recv got EOF from 127.15.242.195:45557 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 07 15:20:41 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:41 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:41.338383 30473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:41.332103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:40753)
0807 15:20:41.332475 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:41.332499 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:41.332656 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:41.333002 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:41.333005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:41.333226 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:41.333324 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:41.333330 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.334122 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.334129 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:41.334692 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:41.334700 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.335176 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.335180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:41.335269 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:41.335838 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:41.335851 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:41.338254 (+ 2403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":119,"threads_started":1}
W20260807 15:20:41.338551 30475 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:41.332269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:40753 (local address 127.15.242.254:36339)
0807 15:20:41.332583 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:41.332587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:41.332602 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:20:41.332820 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:41.332823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:41.332871 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:41.332971 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:41.333453 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.334012 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.334815 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.335051 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.335170 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:41.338385 (+ 3215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:40753: BlockingRecv error: recv got EOF from 127.15.242.193:40753 (error 108)
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":78,"threads_started":1}
Aug 07 15:20:41 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:41 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:41.543121 30476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:41.536569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:37295)
0807 15:20:41.536995 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:41.537008 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:41.537119 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:41.537406 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:41.537408 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:41.537656 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:41.537763 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:41.537769 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.538634 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.538637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:41.539824 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:41.539838 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.540325 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.540329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:41.540394 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:41.541027 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:41.541040 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:41.543006 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":246,"threads_started":1}
W20260807 15:20:41.543341 30475 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:41.536675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:37295 (local address 127.15.242.254:36339)
0807 15:20:41.536991 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:41.536994 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:41.537078 (+ 84us) server_negotiation.cc:407] Connection header received
0807 15:20:41.537202 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:41.537204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:41.537250 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:41.537328 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:41.537906 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.538489 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.539962 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.540209 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.540303 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:41.543182 (+ 2879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:37295: BlockingRecv error: recv got EOF from 127.15.242.194:37295 (error 108)
Metrics: {"server-negotiator.queue_time_us":226}
Aug 07 15:20:41 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:41 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:41.721979 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:41.716017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:39849)
0807 15:20:41.716301 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:41.716313 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:41.716419 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:41.716683 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:41.716686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:41.716921 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:41.717023 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:41.717028 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.717860 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.717864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:41.718464 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:41.718474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.718896 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.718899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:41.718962 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:41.719545 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:41.719557 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:41.721600 (+ 2043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":96,"threads_started":1}
W20260807 15:20:41.721999 30475 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:41.716071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:39849 (local address 127.15.242.254:36339)
0807 15:20:41.716216 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:41.716220 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:41.716388 (+ 168us) server_negotiation.cc:407] Connection header received
0807 15:20:41.716501 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:41.716503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:41.716551 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:41.716622 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:41.717170 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.717728 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.718578 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:41.718795 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:41.718872 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:41.721847 (+ 2975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:39849: BlockingRecv error: recv got EOF from 127.15.242.195:39849 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 15:20:42 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:42 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:42.348714 30482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:42.339300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:51771)
0807 15:20:42.339652 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:42.339665 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:42.339767 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:42.340041 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:42.340044 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:42.340252 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:42.340349 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:42.340355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.341352 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.341354 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:42.341916 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:42.341925 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.342400 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.342403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:42.342476 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:42.346379 (+ 3903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:42.346392 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:42.348518 (+ 2126us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":76,"threads_started":1}
W20260807 15:20:42.348948 30483 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:42.339361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:51771 (local address 127.15.242.254:36339)
0807 15:20:42.339703 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:42.339707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:42.339723 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:20:42.339864 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:42.339866 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:42.339912 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:42.339998 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:42.340507 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.341242 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.342044 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.342289 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.342383 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:42.348741 (+ 6358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:51771: BlockingRecv error: recv got EOF from 127.15.242.193:51771 (error 108)
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":95,"threads_started":1}
Aug 07 15:20:42 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:42 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:42.550328 30484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:42.544004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:55281)
0807 15:20:42.544359 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:42.544374 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:42.544491 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:42.544820 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:42.544823 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:42.545032 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:42.545143 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:42.545149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.545897 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.545899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:42.546510 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:42.546518 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.547003 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.547007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:42.547088 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:42.547622 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:42.547635 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:42.550121 (+ 2486us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
W20260807 15:20:42.550477 30483 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:42.544106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:55281 (local address 127.15.242.254:36339)
0807 15:20:42.544255 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:42.544260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:42.544450 (+ 190us) server_negotiation.cc:407] Connection header received
0807 15:20:42.544595 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:42.544598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:42.544651 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:42.544730 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:42.545259 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.545794 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.546623 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.546855 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.546940 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:42.550297 (+ 3357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:55281: BlockingRecv error: recv got EOF from 127.15.242.194:55281 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 15:20:42 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:42 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:42.729480 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:42.723005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:34967)
0807 15:20:42.723361 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:42.723373 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:42.723517 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:42.723886 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:42.723890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:42.724204 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:42.724349 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:42.724362 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.725421 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.725424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:42.726046 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:42.726055 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.726502 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.726505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:42.726571 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:42.727070 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:42.727083 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:42.729354 (+ 2271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":89,"threads_started":1}
W20260807 15:20:42.729619 30483 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:42.723083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:34967 (local address 127.15.242.254:36339)
0807 15:20:42.723251 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:42.723255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:42.723459 (+ 204us) server_negotiation.cc:407] Connection header received
0807 15:20:42.723636 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:42.723639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:42.723702 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:42.723790 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:42.724503 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.725310 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.726161 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:42.726394 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:42.726476 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:42.729484 (+ 3008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:34967: BlockingRecv error: recv got EOF from 127.15.242.195:34967 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 07 15:20:43 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:43 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:43.355712 30486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:43.349674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:46725)
0807 15:20:43.349999 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:43.350012 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:43.350111 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:43.350372 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:43.350375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:43.350560 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:43.350659 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:43.350664 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.351446 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.351450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:43.352222 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:43.352233 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.352821 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.352826 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:43.352926 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:43.353553 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:43.353566 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:43.355562 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":127,"threads_started":1}
W20260807 15:20:43.356035 30487 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:43.349859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:46725 (local address 127.15.242.254:36339)
0807 15:20:43.350088 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:43.350091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:43.350107 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:20:43.350204 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:43.350206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:43.350252 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:43.350333 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:43.350764 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.351319 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.352360 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.352597 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.352952 (+ 355us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:43.355761 (+ 2809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:46725: BlockingRecv error: recv got EOF from 127.15.242.193:46725 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":64,"threads_started":1}
Aug 07 15:20:43 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:43 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:43.557749 30488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:43.551412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:57837)
0807 15:20:43.551842 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:43.551855 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:43.552001 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:43.552318 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:43.552321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:43.552588 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:43.552728 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:43.552735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.553781 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.553786 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:43.554356 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:43.554364 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.554829 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.554833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:43.554922 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:43.555487 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:43.555499 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:43.557580 (+ 2081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":103,"threads_started":1}
W20260807 15:20:43.557868 30487 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:43.551486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:57837 (local address 127.15.242.254:36339)
0807 15:20:43.551653 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:43.551660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:43.551945 (+ 285us) server_negotiation.cc:407] Connection header received
0807 15:20:43.552105 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:43.552108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:43.552162 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:43.552281 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:43.552881 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.553662 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.554481 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.554710 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.554822 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:43.557723 (+ 2901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:57837: BlockingRecv error: recv got EOF from 127.15.242.194:57837 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 15:20:43 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:43 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:43.736371 30490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:43.730406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:39007)
0807 15:20:43.730716 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:43.730738 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:43.730845 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:43.731156 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:43.731159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:43.731364 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:43.731472 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:43.731477 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.732334 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.732337 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:43.733091 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:43.733103 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.733554 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.733557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:43.733650 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:43.734161 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:43.734174 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:43.736233 (+ 2059us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":96,"threads_started":1}
W20260807 15:20:43.736515 30487 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:43.730455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:39007 (local address 127.15.242.254:36339)
0807 15:20:43.730593 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:43.730597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:43.730810 (+ 213us) server_negotiation.cc:407] Connection header received
0807 15:20:43.730932 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:43.730934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:43.731003 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:43.731101 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:43.731594 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.732220 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.733219 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:43.733439 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:43.733525 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:43.736367 (+ 2842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:39007: BlockingRecv error: recv got EOF from 127.15.242.195:39007 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 15:20:44 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:44 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:44.362965 30491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:44.356614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:46865)
0807 15:20:44.356979 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:44.356995 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:44.357121 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:44.357456 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:44.357459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:44.357722 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:44.357836 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:44.357842 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.358755 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.358758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:44.359324 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:44.359333 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.359844 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.359847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:44.359917 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:44.360534 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:44.360547 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:44.362839 (+ 2292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":130,"threads_started":1}
W20260807 15:20:44.363215 30492 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:44.356709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:46865 (local address 127.15.242.254:36339)
0807 15:20:44.357002 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:44.357006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:44.357075 (+ 69us) server_negotiation.cc:407] Connection header received
0807 15:20:44.357254 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:44.357256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:44.357309 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:44.357393 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:44.357990 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.358627 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.359458 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.359712 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.359799 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:44.363019 (+ 3220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:46865: BlockingRecv error: recv got EOF from 127.15.242.193:46865 (error 108)
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":90,"threads_started":1}
Aug 07 15:20:44 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:44 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:44.564587 30495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:44.558531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:37093)
0807 15:20:44.558830 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:44.558852 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:44.558954 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:44.559184 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:44.559186 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:44.559392 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:44.559493 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:44.559498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.560350 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.560353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:44.561013 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:44.561023 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.561484 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.561487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:44.561549 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:44.562235 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:44.562251 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:44.564397 (+ 2146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":118,"threads_started":1}
W20260807 15:20:44.564633 30492 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:44.558667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:37093 (local address 127.15.242.254:36339)
0807 15:20:44.558813 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:44.558817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:44.558927 (+ 110us) server_negotiation.cc:407] Connection header received
0807 15:20:44.559020 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:44.559023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:44.559068 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:44.559143 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:44.559631 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.560223 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.561133 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.561381 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.561465 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:44.564526 (+ 3061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:37093: BlockingRecv error: recv got EOF from 127.15.242.194:37093 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 15:20:44 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:44 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:44.743564 30496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:44.737254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:35293)
0807 15:20:44.737619 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:44.737634 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:44.737794 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:44.738064 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:44.738067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:44.738352 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:44.738455 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:44.738461 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.739261 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.739265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:44.739983 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:44.739993 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.740586 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.740590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:44.740681 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:44.741191 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:44.741225 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:44.743369 (+ 2144us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":117,"threads_started":1}
W20260807 15:20:44.743619 30492 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:44.737369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:35293 (local address 127.15.242.254:36339)
0807 15:20:44.737572 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:44.737578 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:44.737766 (+ 188us) server_negotiation.cc:407] Connection header received
0807 15:20:44.737884 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:44.737888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:44.737946 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:44.738047 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:44.738584 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.739120 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.740125 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:44.740452 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:44.740580 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:44.743502 (+ 2922us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:35293: BlockingRecv error: recv got EOF from 127.15.242.195:35293 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 07 15:20:45 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:45 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:45.369859 30497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:45.363832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:45861)
0807 15:20:45.364135 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:45.364155 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:45.364255 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:45.364515 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:45.364517 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:45.364712 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:45.364901 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:45.364909 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.365741 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.365744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:45.366399 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:45.366409 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.366893 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.366896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:45.366967 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:45.367652 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:45.367666 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:45.369677 (+ 2011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":86,"threads_started":1}
W20260807 15:20:45.369941 30498 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:45.363918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:45861 (local address 127.15.242.254:36339)
0807 15:20:45.364161 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:45.364164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:45.364228 (+ 64us) server_negotiation.cc:407] Connection header received
0807 15:20:45.364345 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:45.364351 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:45.364395 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:45.364475 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:45.365022 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.365572 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.366515 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.366772 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.366854 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:45.369813 (+ 2959us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:45861: BlockingRecv error: recv got EOF from 127.15.242.193:45861 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":62,"threads_started":1}
Aug 07 15:20:45 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:45 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:45.571375 30499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:45.565432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:39763)
0807 15:20:45.565729 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:45.565744 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:45.565856 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:45.566176 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:45.566179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:45.566376 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:45.566484 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:45.566490 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.567250 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.567253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:45.567864 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:45.567873 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.568417 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.568421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:45.568520 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:45.569205 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:45.569219 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:45.571200 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":73,"threads_started":1}
W20260807 15:20:45.571460 30498 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:45.565591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:39763 (local address 127.15.242.254:36339)
0807 15:20:45.565769 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:45.565773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:45.565804 (+ 31us) server_negotiation.cc:407] Connection header received
0807 15:20:45.565973 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:45.565976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:45.566028 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:45.566113 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:45.566598 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.567145 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.568008 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.568283 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.568411 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:45.571341 (+ 2930us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:39763: BlockingRecv error: recv got EOF from 127.15.242.194:39763 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 15:20:45 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:45 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:45.750736 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:45.744513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:60041)
0807 15:20:45.744987 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:45.745002 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:45.745144 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:45.745576 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:45.745580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:45.745828 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:45.745935 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:45.745941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.746765 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.746768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:45.747402 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:45.747411 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.747902 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.747905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:45.747975 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:45.748512 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:45.748525 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:45.750525 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":122,"threads_started":1}
W20260807 15:20:45.750754 30498 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:45.744693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:60041 (local address 127.15.242.254:36339)
0807 15:20:45.744932 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:45.744937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:45.745113 (+ 176us) server_negotiation.cc:407] Connection header received
0807 15:20:45.745306 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:45.745311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:45.745383 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:45.745470 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:45.746080 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.746616 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.747523 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:45.747787 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:45.747881 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:45.750653 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:60041: BlockingRecv error: recv got EOF from 127.15.242.195:60041 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
Aug 07 15:20:46 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:46 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:46.377117 30502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:46.370696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:39711)
0807 15:20:46.371098 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:46.371114 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:46.371240 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:46.371515 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:46.371518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:46.371741 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:46.371852 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:46.371858 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.372644 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.372648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:46.373355 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:46.373366 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.373991 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.373994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:46.374064 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:46.374645 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:46.374662 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:46.376905 (+ 2243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":91,"threads_started":1}
W20260807 15:20:46.377285 30504 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:46.370829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:39711 (local address 127.15.242.254:36339)
0807 15:20:46.371087 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:46.371090 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:46.371201 (+ 111us) server_negotiation.cc:407] Connection header received
0807 15:20:46.371327 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:46.371329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:46.371374 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:46.371455 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:46.371974 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.372526 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.373532 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.373834 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.373947 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:46.377098 (+ 3151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:39711: BlockingRecv error: recv got EOF from 127.15.242.193:39711 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":64,"threads_started":1}
Aug 07 15:20:46 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:46 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:46.578131 30507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:46.572243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:58717)
0807 15:20:46.572639 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:46.572654 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:46.572809 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:46.573082 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:46.573085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:46.573305 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:46.573413 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:46.573420 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.574206 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.574209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:46.574789 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:46.574798 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.575264 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.575268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:46.575354 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:46.575904 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:46.575918 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:46.577950 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":138,"threads_started":1}
W20260807 15:20:46.578178 30504 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:46.572378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:58717 (local address 127.15.242.254:36339)
0807 15:20:46.572545 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:46.572548 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:46.572730 (+ 182us) server_negotiation.cc:407] Connection header received
0807 15:20:46.572910 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:46.572912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:46.572958 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:46.573029 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:46.573526 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.574058 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.574910 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.575130 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.575225 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:46.578078 (+ 2853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:58717: BlockingRecv error: recv got EOF from 127.15.242.194:58717 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 07 15:20:46 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:46 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:46.757313 30509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:46.751629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:38347)
0807 15:20:46.751965 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:46.751980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:46.752107 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:46.752359 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:46.752362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:46.752568 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:46.752678 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:46.752683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.753518 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.753522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:46.754163 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:46.754181 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.754602 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.754605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:46.754673 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:46.755191 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:46.755205 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:46.757189 (+ 1984us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":144,"threads_started":1}
W20260807 15:20:46.757431 30504 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:46.751711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:38347 (local address 127.15.242.254:36339)
0807 15:20:46.751865 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:46.751870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:46.752041 (+ 171us) server_negotiation.cc:407] Connection header received
0807 15:20:46.752181 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:46.752183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:46.752246 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:46.752314 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:46.752807 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.753403 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.754286 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:46.754499 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:46.754576 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:46.757336 (+ 2760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:38347: BlockingRecv error: recv got EOF from 127.15.242.195:38347 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 15:20:47 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:47 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:47.388849 30510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:47.378070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:39669)
0807 15:20:47.378587 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:47.378611 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:47.378807 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:47.379035 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:47.379037 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:47.379243 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:47.379343 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:47.379348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.380121 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.380125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:47.380720 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:47.380730 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.381299 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.381303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:47.381383 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:47.386577 (+ 5194us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:47.386590 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:47.388637 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":91,"threads_started":1}
W20260807 15:20:47.389132 30511 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:47.378175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:39669 (local address 127.15.242.254:36339)
0807 15:20:47.378471 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:47.378475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:47.378763 (+ 288us) server_negotiation.cc:407] Connection header received
0807 15:20:47.378892 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:47.378894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:47.378943 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:47.379020 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:47.379444 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.379984 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.380948 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.381173 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.381270 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:47.388835 (+ 7565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:39669: BlockingRecv error: recv got EOF from 127.15.242.193:39669 (error 108)
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":101,"threads_started":1}
Aug 07 15:20:47 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:47 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:47.584986 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:47.579142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:40233)
0807 15:20:47.579478 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:47.579491 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:47.579629 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:47.579928 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:47.579931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:47.580124 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:47.580247 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:47.580253 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.581093 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.581096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:47.581668 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:47.581676 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.582159 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.582161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:47.582244 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:47.582844 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:47.582857 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:47.584862 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":93,"threads_started":1}
W20260807 15:20:47.585219 30511 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:47.579272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:40233 (local address 127.15.242.254:36339)
0807 15:20:47.579433 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:47.579438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:47.579582 (+ 144us) server_negotiation.cc:407] Connection header received
0807 15:20:47.579726 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:47.579730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:47.579798 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:47.579873 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:47.580362 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.580991 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.581799 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.582048 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.582140 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:47.585068 (+ 2928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:40233: BlockingRecv error: recv got EOF from 127.15.242.194:40233 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 15:20:47 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:47 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:47.764528 30513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:47.758409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:42861)
0807 15:20:47.758710 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:47.758724 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:47.758848 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:47.759160 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:47.759163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:47.759378 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:47.759487 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:47.759493 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.760375 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.760378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:47.761020 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:47.761030 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.761524 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.761527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:47.761594 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:47.762228 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:47.762241 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:47.764405 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":162,"threads_started":1}
W20260807 15:20:47.764837 30511 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:47.758459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:42861 (local address 127.15.242.254:36339)
0807 15:20:47.758625 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:47.758631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:47.758805 (+ 174us) server_negotiation.cc:407] Connection header received
0807 15:20:47.758945 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:47.758947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:47.758999 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:47.759094 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:47.759634 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.760240 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.761154 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:47.761403 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:47.761505 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:47.764668 (+ 3163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:42861: BlockingRecv error: recv got EOF from 127.15.242.195:42861 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 15:20:48 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:48 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:48.395785 30514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:48.389704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:58323)
0807 15:20:48.389994 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:48.390008 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:48.390099 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:48.390398 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:48.390401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:48.390595 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:48.390704 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:48.390710 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.391596 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.391599 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:48.392182 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:48.392192 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.392709 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.392712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:48.392858 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:48.393389 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:48.393402 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:48.395591 (+ 2189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":91,"threads_started":1}
W20260807 15:20:48.395877 30515 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:48.389773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:58323 (local address 127.15.242.254:36339)
0807 15:20:48.390032 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:48.390036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:48.390068 (+ 32us) server_negotiation.cc:407] Connection header received
0807 15:20:48.390202 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:48.390204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:48.390253 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:48.390328 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:48.390864 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.391477 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.392326 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.392580 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.392680 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:48.395765 (+ 3085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:58323: BlockingRecv error: recv got EOF from 127.15.242.193:58323 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":63,"threads_started":1}
Aug 07 15:20:48 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:48 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:48.591562 30516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:48.585839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:48947)
0807 15:20:48.586129 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:48.586142 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:48.586244 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:48.586486 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:48.586495 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:48.586690 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:48.586800 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:48.586805 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.587574 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.587576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:48.588177 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:48.588185 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.588682 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.588684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:48.588815 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:48.589361 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:48.589373 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:48.591435 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":78,"threads_started":1}
W20260807 15:20:48.591737 30515 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:48.586007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:48947 (local address 127.15.242.254:36339)
0807 15:20:48.586201 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:48.586205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:48.586222 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:20:48.586319 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:48.586321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:48.586369 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:48.586446 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:48.586943 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.587471 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.588319 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.588562 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.588670 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:48.591578 (+ 2908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:48947: BlockingRecv error: recv got EOF from 127.15.242.194:48947 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 07 15:20:48 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:48 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:48.771242 30517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:48.765332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:41947)
0807 15:20:48.765680 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:48.765695 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:48.765808 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:48.766103 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:48.766106 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:48.766308 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:48.766410 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:48.766415 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.767222 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.767226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:48.767783 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:48.767791 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.768270 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.768273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:48.768371 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:48.768989 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:48.769005 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:48.771126 (+ 2121us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":95,"threads_started":1}
W20260807 15:20:48.771497 30515 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:48.765494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:41947 (local address 127.15.242.254:36339)
0807 15:20:48.765675 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:48.765679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:48.765772 (+ 93us) server_negotiation.cc:407] Connection header received
0807 15:20:48.765898 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:48.765901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:48.765952 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:48.766045 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:48.766523 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.767107 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.767898 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:48.768119 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:48.768243 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:48.771345 (+ 3102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:41947: BlockingRecv error: recv got EOF from 127.15.242.195:41947 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 15:20:49 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:49 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:49.402738 30518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:49.396690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:39143)
0807 15:20:49.397155 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:49.397183 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:49.397283 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:49.397549 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:49.397552 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:49.397767 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:49.397868 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:49.397874 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.398744 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.398747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:49.399426 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:49.399435 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.399963 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.399966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:49.400038 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:49.400599 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:49.400618 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:49.402603 (+ 1985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":125,"threads_started":1}
W20260807 15:20:49.402894 30521 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:49.396745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:39143 (local address 127.15.242.254:36339)
0807 15:20:49.397246 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:49.397250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:49.397265 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:20:49.397375 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:49.397377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:49.397422 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:49.397503 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:49.397987 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.398546 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.399534 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.399851 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.399942 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:49.402755 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:39143: BlockingRecv error: recv got EOF from 127.15.242.193:39143 (error 108)
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":106,"threads_started":1}
Aug 07 15:20:49 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:49 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:49.598582 30522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:49.592500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:48937)
0807 15:20:49.592865 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:49.592879 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:49.592981 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:49.593209 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:49.593211 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:49.593407 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:49.593513 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:49.593518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.594492 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.594496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:49.595344 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:49.595358 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.595837 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.595841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:49.595914 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:49.596435 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:49.596447 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:49.598449 (+ 2002us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":142,"threads_started":1}
W20260807 15:20:49.598717 30521 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:49.592596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:48937 (local address 127.15.242.254:36339)
0807 15:20:49.592748 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:49.592751 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:49.592934 (+ 183us) server_negotiation.cc:407] Connection header received
0807 15:20:49.593050 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:49.593052 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:49.593096 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:49.593167 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:49.593622 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.594329 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.595465 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.595686 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.595775 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:49.598591 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:48937: BlockingRecv error: recv got EOF from 127.15.242.194:48937 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 15:20:49 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:49 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.195@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:49.778530 30523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:49.772264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.195:41857)
0807 15:20:49.772538 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:49.772557 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:49.772735 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:49.773156 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:49.773159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:49.773366 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:49.773475 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:49.773481 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.774338 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.774341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:49.774925 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:49.774933 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.775432 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.775435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:49.775501 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:49.776064 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:49.776077 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:49.778280 (+ 2203us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":94,"threads_started":1}
W20260807 15:20:49.778587 30521 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:49.772315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:41857 (local address 127.15.242.254:36339)
0807 15:20:49.772462 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:49.772466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:49.772630 (+ 164us) server_negotiation.cc:407] Connection header received
0807 15:20:49.772908 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:49.772911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:49.772975 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:49.773051 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:49.773630 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.774218 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.775056 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:49.775318 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:49.775410 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:49.778458 (+ 3048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.195:41857: BlockingRecv error: recv got EOF from 127.15.242.195:41857 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 15:20:50 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:50 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.193@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:50.409871 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:50.403760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.193:40533)
0807 15:20:50.404099 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:50.404114 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:50.404227 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:50.404498 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:50.404501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:50.404889 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:50.405028 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:50.405035 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.405985 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.406001 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:50.406613 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:50.406629 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.407107 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.407111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:50.407190 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:50.407717 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:50.407729 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:50.409751 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":110,"threads_started":1}
W20260807 15:20:50.410065 30525 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:50.403861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:40533 (local address 127.15.242.254:36339)
0807 15:20:50.404121 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:50.404125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:50.404200 (+ 75us) server_negotiation.cc:407] Connection header received
0807 15:20:50.404315 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:50.404317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:50.404362 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:50.404442 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:50.405212 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.405865 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.406749 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.406986 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.407101 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:50.409915 (+ 2814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.193:40533: BlockingRecv error: recv got EOF from 127.15.242.193:40533 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":70,"threads_started":1}
Aug 07 15:20:50 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 15:20:50 dist-test-slave-g170 krb5kdc[28902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.242.194@KRBTEST.COM for oryx/127.15.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 15:20:50.605660 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:50.599533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:36339 (local address 127.15.242.194:46551)
0807 15:20:50.599929 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:50.599943 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:50.600050 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:50.600266 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:50.600268 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:50.600511 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:50.600623 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:50.600629 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.601466 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.601469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:50.602127 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:50.602137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.602558 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.602560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:50.602645 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:50.603156 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:50.603169 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:50.605488 (+ 2319us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.242.254:36339: Server oryx/127.15.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":100,"threads_started":1}
W20260807 15:20:50.605732 30525 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:50.599690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:46551 (local address 127.15.242.254:36339)
0807 15:20:50.599858 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:50.599862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:50.600030 (+ 168us) server_negotiation.cc:407] Connection header received
0807 15:20:50.600136 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:50.600138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:50.600183 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:50.600252 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:50.600802 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.601348 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.602241 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.602456 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.602531 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:50.605613 (+ 3082us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.242.194:46551: BlockingRecv error: recv got EOF from 127.15.242.194:46551 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 15:20:50.662068 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 29817
I20260807 15:20:50.678524 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 30035
I20260807 15:20:50.689208 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 30230
I20260807 15:20:50.701145 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 29707
2026-08-07T15:20:50Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18477 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T15:20:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:50Z Disabled control of system clock
I20260807 15:20:50.741783 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:34851
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:34851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 15:20:50.861538 30531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:50.861799 30531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:50.861833 30531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:50.865715 30531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:50.865767 30531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:50.865783 30531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:50.865799 30531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:50.865814 30531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:50.870508 30531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:34851
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:34851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:50.871523 30531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:50.872941 30531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:50.882375 30536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:50.882345 30537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:50.882361 30544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:50.882480 30531 server_base.cc:1034] running on GCE node
I20260807 15:20:50.883240 30531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:50.884505 30531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:50.885707 30531 hybrid_clock.cc:648] HybridClock initialized: now 1786116050885695 us; error 33 us; skew 500 ppm
I20260807 15:20:50.887787 30531 webserver.cc:460] Webserver started at http://127.15.242.254:38805/ using document root <none> and password file <none>
I20260807 15:20:50.888392 30531 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:50.888458 30531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:50.888715 30531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:50.890887 30531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "811265194e8a4433be3a42c94c911183"
format_stamp: "Formatted at 2026-08-07 15:20:50 on dist-test-slave-g170"
server_key: "9f581f5b34937962a0111ad3c868dd4c"
server_key_iv: "7d743f296beaab1837e205f2a33eee43"
server_key_version: "encryptionkey@0"
I20260807 15:20:50.891480 30531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "811265194e8a4433be3a42c94c911183"
format_stamp: "Formatted at 2026-08-07 15:20:50 on dist-test-slave-g170"
server_key: "9f581f5b34937962a0111ad3c868dd4c"
server_key_iv: "7d743f296beaab1837e205f2a33eee43"
server_key_version: "encryptionkey@0"
I20260807 15:20:50.895401 30531 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:50.898197 30553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:50.899704 30531 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:20:50.899868 30531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "811265194e8a4433be3a42c94c911183"
format_stamp: "Formatted at 2026-08-07 15:20:50 on dist-test-slave-g170"
server_key: "9f581f5b34937962a0111ad3c868dd4c"
server_key_iv: "7d743f296beaab1837e205f2a33eee43"
server_key_version: "encryptionkey@0"
I20260807 15:20:50.899996 30531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:50.940665 30531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:50.941547 30531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:50.941800 30531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:50.949872 30531 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:34851
I20260807 15:20:50.949882 30633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:34851 every 8 connection(s)
I20260807 15:20:50.950958 30531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:50.954509 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:50.958590 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 30531
I20260807 15:20:50.958801 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:50.959141 16331 external_mini_cluster.cc:1428] Setting key b57235711eb953488a3b30f9e242f766
I20260807 15:20:50.960726 30637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183: Bootstrap starting.
I20260807 15:20:50.963714 30637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:50.964653 30637 log.cc:824] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:50.966840 30637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183: No bootstrap required, opened a new log
I20260807 15:20:50.970582 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:50.960684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42440 (local address 127.15.242.254:34851)
0807 15:20:50.961608 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:50.961630 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:50.961674 (+ 44us) server_negotiation.cc:407] Connection header received
0807 15:20:50.962562 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:50.962586 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:50.963168 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:50.963540 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:50.964047 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.965511 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.966423 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:50.967129 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:50.967302 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:50.968270 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:50.968277 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:50.968293 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:50.968832 (+ 539us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:50.968906 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:50.968935 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:50.969043 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:50.969223 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 15:20:50.969546 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":167,"threads_started":1}
I20260807 15:20:50.971666 30637 raft_consensus.cc:348] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811265194e8a4433be3a42c94c911183" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34851 } }
I20260807 15:20:50.971951 30637 raft_consensus.cc:374] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:50.972015 30637 raft_consensus.cc:729] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811265194e8a4433be3a42c94c911183, State: Initialized, Role: FOLLOWER
I20260807 15:20:50.972497 30637 consensus_queue.cc:260] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811265194e8a4433be3a42c94c911183" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34851 } }
I20260807 15:20:50.972632 30637 raft_consensus.cc:388] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:50.972711 30637 raft_consensus.cc:482] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:50.972829 30637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:50.973930 30637 raft_consensus.cc:504] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811265194e8a4433be3a42c94c911183" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34851 } }
I20260807 15:20:50.974292 30637 leader_election.cc:302] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 811265194e8a4433be3a42c94c911183; no voters:
I20260807 15:20:50.974661 30637 leader_election.cc:288] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:50.974735 30646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:50.974990 30646 raft_consensus.cc:686] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [term 1 LEADER]: Becoming Leader. State: Replica: 811265194e8a4433be3a42c94c911183, State: Running, Role: LEADER
I20260807 15:20:50.975399 30646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811265194e8a4433be3a42c94c911183" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34851 } }
I20260807 15:20:50.976068 30637 sys_catalog.cc:564] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:50.977252 30647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "811265194e8a4433be3a42c94c911183" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811265194e8a4433be3a42c94c911183" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34851 } } }
I20260807 15:20:50.977388 30647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:50.977768 30648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 811265194e8a4433be3a42c94c911183. Latest consensus state: current_term: 1 leader_uuid: "811265194e8a4433be3a42c94c911183" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811265194e8a4433be3a42c94c911183" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34851 } } }
I20260807 15:20:50.977916 30648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:50.977833 30659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:50.980952 30659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:50.987565 30659 catalog_manager.cc:1347] Generated new cluster ID: f051734e6c994fbca5674d1b427e8a8d
I20260807 15:20:50.987699 30659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:51.002902 30659 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:51.004244 30659 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:51.011837 30659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 811265194e8a4433be3a42c94c911183: Generated new TSK 0
I20260807 15:20:51.012712 30659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:20:51.016656 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34851
--builtin_ntp_servers=127.15.242.212:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 15:20:51.138019 30679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:51.138280 30679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:51.138334 30679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:51.142355 30679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:51.142412 30679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:51.142464 30679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:51.147351 30679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:51.148514 30679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:51.149995 30679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:51.160266 30690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:51.160343 30693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:51.160279 30691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:51.160519 30679 server_base.cc:1034] running on GCE node
I20260807 15:20:51.161067 30679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:51.161860 30679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:51.163074 30679 hybrid_clock.cc:648] HybridClock initialized: now 1786116051163055 us; error 38 us; skew 500 ppm
I20260807 15:20:51.165290 30679 webserver.cc:460] Webserver started at http://127.15.242.193:46147/ using document root <none> and password file <none>
I20260807 15:20:51.165910 30679 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:51.165982 30679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:51.166219 30679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:51.168332 30679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "0b8efe6224a84387a64ed6494ae5f051"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "37c9696f5926decb3f652e966c34936c"
server_key_iv: "312a1e86c703cac4ef161bf29881cf4b"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.168977 30679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "0b8efe6224a84387a64ed6494ae5f051"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "37c9696f5926decb3f652e966c34936c"
server_key_iv: "312a1e86c703cac4ef161bf29881cf4b"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.173481 30679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:20:51.176815 30699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.178179 30679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:20:51.178363 30679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "0b8efe6224a84387a64ed6494ae5f051"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "37c9696f5926decb3f652e966c34936c"
server_key_iv: "312a1e86c703cac4ef161bf29881cf4b"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.178490 30679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:51.192279 30679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:51.193073 30679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:51.193296 30679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:51.193910 30679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:51.194880 30679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:51.194954 30679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.195027 30679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:51.195079 30679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.204567 30679 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:41431
I20260807 15:20:51.204650 30881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:41431 every 8 connection(s)
I20260807 15:20:51.205587 30679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:51.215266 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 30679
I20260807 15:20:51.215390 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:51.215718 16331 external_mini_cluster.cc:1428] Setting key 1de34345730cf4e1154f04bc461eb946
I20260807 15:20:51.215807 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:51.207473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:42765 (local address 127.15.242.254:34851)
0807 15:20:51.207644 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:51.207649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:51.208817 (+ 1168us) server_negotiation.cc:407] Connection header received
0807 15:20:51.210291 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:51.210294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:51.210344 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:51.210426 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:51.211522 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.212088 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.213460 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.213775 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.213872 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:51.215097 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:51.215104 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:51.215109 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:51.215126 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:51.215154 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:51.215166 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:51.215256 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:51.215570 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 15:20:51.215645 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 15:20:51.216996 30884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:51.207903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34851 (local address 127.15.242.193:42765)
0807 15:20:51.208572 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:51.208613 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:51.210067 (+ 1454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:51.210722 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:51.210730 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:51.210823 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:51.211377 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:51.211392 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.212222 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.212225 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:51.213324 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:51.213335 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.213950 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.213954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:51.214113 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:51.214811 (+ 698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:51.214813 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:51.214855 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:51.214919 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:51.215282 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:51.215291 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:51.215297 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 15:20:51.215557 (+ 260us) client_negotiation.cc:240] Negotiation successful
0807 15:20:51.215945 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":113,"threads_started":1}
I20260807 15:20:51.218158 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34851
--builtin_ntp_servers=127.15.242.212:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 15:20:51.218428 30882 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34851
I20260807 15:20:51.218693 30882 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:51.219280 30882 heartbeater.cc:511] Master 127.15.242.254:34851 requested a full tablet report, sending...
I20260807 15:20:51.220978 30579 ts_manager.cc:194] Registered new tserver with Master: 0b8efe6224a84387a64ed6494ae5f051 (127.15.242.193:41431)
I20260807 15:20:51.222265 30579 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.193:42765
W20260807 15:20:51.338394 30885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:51.338661 30885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:51.338707 30885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:51.342808 30885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:51.342861 30885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:51.342916 30885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:51.347658 30885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:51.348735 30885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:51.350183 30885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:51.360369 30892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:51.360425 30885 server_base.cc:1034] running on GCE node
W20260807 15:20:51.360369 30893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:51.360404 30896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:51.361100 30885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:51.361706 30885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:51.362906 30885 hybrid_clock.cc:648] HybridClock initialized: now 1786116051362870 us; error 47 us; skew 500 ppm
I20260807 15:20:51.364751 30885 webserver.cc:460] Webserver started at http://127.15.242.194:33711/ using document root <none> and password file <none>
I20260807 15:20:51.365458 30885 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:51.365552 30885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:51.365798 30885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:51.367822 30885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "cc236274b6b74f72a3b9c454d15e293a"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "3f377faa0343a3c2a56b9df2ccac0dc4"
server_key_iv: "808b5c6315bb1eecb9a27610a577779f"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.368379 30885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "cc236274b6b74f72a3b9c454d15e293a"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "3f377faa0343a3c2a56b9df2ccac0dc4"
server_key_iv: "808b5c6315bb1eecb9a27610a577779f"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.372072 30885 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260807 15:20:51.374588 30904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.375818 30885 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:51.375972 30885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "cc236274b6b74f72a3b9c454d15e293a"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "3f377faa0343a3c2a56b9df2ccac0dc4"
server_key_iv: "808b5c6315bb1eecb9a27610a577779f"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.376106 30885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:51.401346 30885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:51.402043 30885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:51.402248 30885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:51.402874 30885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:51.403878 30885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:51.403955 30885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.404011 30885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:51.404028 30885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.413417 30885 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:37233
I20260807 15:20:51.413448 31068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:37233 every 8 connection(s)
I20260807 15:20:51.414318 30885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:51.416224 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 30885
I20260807 15:20:51.416337 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:51.416682 16331 external_mini_cluster.cc:1428] Setting key 151d5580296989e88f41b7d8e68627ee
I20260807 15:20:51.419044 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34851
--builtin_ntp_servers=127.15.242.212:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 15:20:51.425480 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:51.416175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:42605 (local address 127.15.242.254:34851)
0807 15:20:51.416351 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:51.416357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:51.417904 (+ 1547us) server_negotiation.cc:407] Connection header received
0807 15:20:51.419627 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:51.419634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:51.419701 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:51.419798 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:51.420682 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.421361 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.423150 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.423370 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.423451 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:51.424984 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:51.424988 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:51.424990 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:51.425002 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:51.425022 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:51.425030 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:51.425093 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:51.425319 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 15:20:51.425370 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:20:51.426834 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:51.416721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34851 (local address 127.15.242.194:42605)
0807 15:20:51.417674 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:51.417792 (+ 118us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:51.419376 (+ 1584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:51.419966 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:51.419973 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:51.420056 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:51.420538 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:51.420551 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.421509 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.421515 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:51.423011 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:51.423027 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.423535 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.423542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:51.423781 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:51.424615 (+ 834us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:51.424620 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:51.424692 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:51.424813 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:51.425142 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:51.425156 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:51.425164 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 15:20:51.425317 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 15:20:51.425653 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":157,"threads_started":1}
I20260807 15:20:51.428035 31072 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34851
I20260807 15:20:51.428296 31072 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:51.428884 31072 heartbeater.cc:511] Master 127.15.242.254:34851 requested a full tablet report, sending...
I20260807 15:20:51.430009 30579 ts_manager.cc:194] Registered new tserver with Master: cc236274b6b74f72a3b9c454d15e293a (127.15.242.194:37233)
I20260807 15:20:51.430929 30579 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.194:42605
W20260807 15:20:51.539744 31080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:51.540025 31080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:51.540068 31080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:51.544428 31080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:51.544482 31080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:51.544533 31080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:51.549958 31080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:51.551038 31080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:51.552547 31080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:51.563254 31088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:51.563386 31085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:51.563329 31091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:51.563512 31080 server_base.cc:1034] running on GCE node
I20260807 15:20:51.564116 31080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:51.565089 31080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:51.566286 31080 hybrid_clock.cc:648] HybridClock initialized: now 1786116051566254 us; error 44 us; skew 500 ppm
I20260807 15:20:51.568205 31080 webserver.cc:460] Webserver started at http://127.15.242.195:34715/ using document root <none> and password file <none>
I20260807 15:20:51.568964 31080 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:51.569036 31080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:51.569224 31080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:51.571329 31080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "e42304fcbe934592ac8d2014847403e2"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "a88a706f3c0370fcceb9bafd2afa38fe"
server_key_iv: "3c2e5dee058e29e64cdbb251e9ba5518"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.571863 31080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "e42304fcbe934592ac8d2014847403e2"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "a88a706f3c0370fcceb9bafd2afa38fe"
server_key_iv: "3c2e5dee058e29e64cdbb251e9ba5518"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.575901 31080 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 15:20:51.578794 31098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.580219 31080 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:20:51.580322 31080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "e42304fcbe934592ac8d2014847403e2"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "a88a706f3c0370fcceb9bafd2afa38fe"
server_key_iv: "3c2e5dee058e29e64cdbb251e9ba5518"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.580410 31080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:51.600894 31080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:51.601645 31080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:51.601871 31080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:51.602507 31080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:51.603591 31080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:51.603641 31080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.603720 31080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:51.603752 31080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.613479 31080 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:33849
I20260807 15:20:51.613510 31289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:33849 every 8 connection(s)
I20260807 15:20:51.614437 31080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:51.617797 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 31080
I20260807 15:20:51.617929 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:51.618294 16331 external_mini_cluster.cc:1428] Setting key 82a05a4516295ad6e49390d700d012d4
I20260807 15:20:51.625267 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:51.616722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:57505 (local address 127.15.242.254:34851)
0807 15:20:51.616918 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:51.616923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:51.618221 (+ 1298us) server_negotiation.cc:407] Connection header received
0807 15:20:51.620181 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:51.620185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:51.620234 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:51.620319 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:51.621418 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.622014 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.623208 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.623475 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.623637 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:51.624707 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:51.624710 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:51.624712 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:51.624733 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:51.624751 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:51.624847 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:51.624927 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:51.625092 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 15:20:51.625144 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 15:20:51.626113 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:51.617183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34851 (local address 127.15.242.195:57505)
0807 15:20:51.618039 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:51.618095 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:51.619952 (+ 1857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:51.620532 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:51.620543 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:51.620655 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:51.621265 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:51.621279 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.622131 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.622133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:51.623022 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:51.623031 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:51.623627 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:51.623630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:51.623771 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:51.624384 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:51.624386 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:51.624426 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:51.624509 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:51.624949 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:51.624958 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:51.624963 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 15:20:51.625067 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 15:20:51.625338 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":137,"threads_started":1}
I20260807 15:20:51.627283 31292 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34851
I20260807 15:20:51.627493 31292 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:51.627974 31292 heartbeater.cc:511] Master 127.15.242.254:34851 requested a full tablet report, sending...
I20260807 15:20:51.629043 30579 ts_manager.cc:194] Registered new tserver with Master: e42304fcbe934592ac8d2014847403e2 (127.15.242.195:33849)
I20260807 15:20:51.629645 30579 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.195:57505
I20260807 15:20:51.632493 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 15:20:51.635316 30641 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:51.634523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42452 (local address 127.15.242.254:34851)
0807 15:20:51.634665 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:51.634670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:51.634824 (+ 154us) server_negotiation.cc:407] Connection header received
0807 15:20:51.634917 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:51.634919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:51.634957 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:51.635027 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:51.635220 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42452: BlockingRecv error: recv got EOF from 127.0.0.1:42452 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 15:20:51.635560 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 30679
I20260807 15:20:51.662107 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 30885
I20260807 15:20:51.679263 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 31080
I20260807 15:20:51.696161 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 30531
2026-08-07T15:20:51Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (990 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T15:20:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:51Z Disabled control of system clock
I20260807 15:20:51.732055 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45799
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:35645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:45799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 15:20:51.847196 31308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:51.847576 31308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:51.847615 31308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:51.851608 31308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:51.851666 31308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:51.851681 31308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:51.851698 31308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:51.851713 31308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:51.856427 31308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:45799
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:51.858055 31308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:51.859543 31308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:51.868201 31315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:51.868270 31320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:51.868196 31317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:51.868453 31308 server_base.cc:1034] running on GCE node
I20260807 15:20:51.869297 31308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:51.870393 31308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:51.871558 31308 hybrid_clock.cc:648] HybridClock initialized: now 1786116051871545 us; error 75 us; skew 500 ppm
I20260807 15:20:51.873561 31308 webserver.cc:460] Webserver started at http://127.15.242.254:41989/ using document root <none> and password file <none>
I20260807 15:20:51.874152 31308 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:51.874226 31308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:51.874449 31308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:51.876507 31308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "9790164f316141408374849269af1ed4"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "3ba4519457a35f23020c60db794163d4"
server_key_iv: "d98e662fc15d18cdcc759aa6a17d05f3"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.877130 31308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "9790164f316141408374849269af1ed4"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "3ba4519457a35f23020c60db794163d4"
server_key_iv: "d98e662fc15d18cdcc759aa6a17d05f3"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.881124 31308 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:20:51.883829 31329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:51.885282 31308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:51.885435 31308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "9790164f316141408374849269af1ed4"
format_stamp: "Formatted at 2026-08-07 15:20:51 on dist-test-slave-g170"
server_key: "3ba4519457a35f23020c60db794163d4"
server_key_iv: "d98e662fc15d18cdcc759aa6a17d05f3"
server_key_version: "encryptionkey@0"
I20260807 15:20:51.885565 31308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:51.890884 31308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:51.891552 31308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:51.891765 31308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:51.899808 31308 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:45799
I20260807 15:20:51.899827 31404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:45799 every 8 connection(s)
I20260807 15:20:51.900889 31308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:51.904305 31406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:51.908458 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 31308
I20260807 15:20:51.908605 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:51.908972 16331 external_mini_cluster.cc:1428] Setting key 118e7bbe7d89750928264af1536b49fe
I20260807 15:20:51.910483 31406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4: Bootstrap starting.
I20260807 15:20:51.912936 31406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:51.913829 31406 log.cc:824] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:51.914911 31411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:51.910533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56352 (local address 127.15.242.254:45799)
0807 15:20:51.911278 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:51.911294 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:51.911331 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:20:51.912010 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:51.912029 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:51.912389 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:51.912792 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:51.913614 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:51.913618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:51.913631 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:51.913640 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:51.913691 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:51.913706 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:51.913837 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:51.913939 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 15:20:51.914217 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":144,"threads_started":1}
I20260807 15:20:51.916080 31406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4: No bootstrap required, opened a new log
I20260807 15:20:51.919870 31406 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9790164f316141408374849269af1ed4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45799 } }
I20260807 15:20:51.920154 31406 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:51.920243 31406 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9790164f316141408374849269af1ed4, State: Initialized, Role: FOLLOWER
I20260807 15:20:51.920738 31406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9790164f316141408374849269af1ed4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45799 } }
I20260807 15:20:51.920956 31406 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:51.921053 31406 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:51.921167 31406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:51.922359 31406 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9790164f316141408374849269af1ed4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45799 } }
I20260807 15:20:51.922734 31406 leader_election.cc:302] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9790164f316141408374849269af1ed4; no voters:
I20260807 15:20:51.923069 31406 leader_election.cc:288] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:51.923229 31414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:51.923507 31414 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [term 1 LEADER]: Becoming Leader. State: Replica: 9790164f316141408374849269af1ed4, State: Running, Role: LEADER
I20260807 15:20:51.923841 31414 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9790164f316141408374849269af1ed4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45799 } }
I20260807 15:20:51.924436 31406 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:51.925961 31416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9790164f316141408374849269af1ed4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9790164f316141408374849269af1ed4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45799 } } }
I20260807 15:20:51.926097 31416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:51.926364 31417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9790164f316141408374849269af1ed4. Latest consensus state: current_term: 1 leader_uuid: "9790164f316141408374849269af1ed4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9790164f316141408374849269af1ed4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45799 } } }
I20260807 15:20:51.926534 31417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4 [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:51.926594 31425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:51.930387 31425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:51.936316 31425 catalog_manager.cc:1347] Generated new cluster ID: 1c4822f7261a49d3acedfdd6296ce42d
I20260807 15:20:51.936390 31425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:51.954480 31425 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:51.954808 31425 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:51.962006 31425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9790164f316141408374849269af1ed4: Generated new TSK 0
I20260807 15:20:51.962797 31425 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:20:51.976373 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45799
--builtin_ntp_servers=127.15.242.212:35645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 15:20:52.097882 31438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:52.098266 31438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:52.098366 31438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:52.106592 31438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:52.106673 31438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:52.106775 31438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:52.112179 31438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:52.113407 31438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:52.114894 31438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:52.125036 31448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:52.125123 31438 server_base.cc:1034] running on GCE node
W20260807 15:20:52.124990 31446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:52.125048 31445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:52.125883 31438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:52.126720 31438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:52.127919 31438 hybrid_clock.cc:648] HybridClock initialized: now 1786116052127902 us; error 30 us; skew 500 ppm
I20260807 15:20:52.130386 31438 webserver.cc:460] Webserver started at http://127.15.242.193:46181/ using document root <none> and password file <none>
I20260807 15:20:52.131049 31438 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:52.131124 31438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:52.131367 31438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:52.133791 31438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "aa6867ad6be24f00b03479b45630873b"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "b7b2f9c930f924bc567b12d6eb8ffec6"
server_key_iv: "4351277bb3fbc1ec7b7ee1ea347f32e9"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.134428 31438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "aa6867ad6be24f00b03479b45630873b"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "b7b2f9c930f924bc567b12d6eb8ffec6"
server_key_iv: "4351277bb3fbc1ec7b7ee1ea347f32e9"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.138724 31438 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 15:20:52.141665 31460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.143075 31438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:20:52.143236 31438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "aa6867ad6be24f00b03479b45630873b"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "b7b2f9c930f924bc567b12d6eb8ffec6"
server_key_iv: "4351277bb3fbc1ec7b7ee1ea347f32e9"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.143364 31438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:52.148173 31438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:52.148898 31438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:52.149092 31438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:52.149667 31438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:52.150650 31438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:52.150722 31438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.150794 31438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:52.150842 31438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.160666 31438 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:44707
I20260807 15:20:52.160686 31649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:44707 every 8 connection(s)
I20260807 15:20:52.161693 31438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:52.165859 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 31438
I20260807 15:20:52.166019 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:52.166441 16331 external_mini_cluster.cc:1428] Setting key 9d98d3e31ad30e967c5138fcc1a5d4ec
I20260807 15:20:52.168655 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45799
--builtin_ntp_servers=127.15.242.212:35645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 15:20:52.169087 31411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:52.163605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:57075 (local address 127.15.242.254:45799)
0807 15:20:52.163786 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:52.163791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:52.165098 (+ 1307us) server_negotiation.cc:407] Connection header received
0807 15:20:52.167059 (+ 1961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:52.167062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:52.167113 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:52.167212 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:52.168496 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:52.168500 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:52.168503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:52.168517 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:52.168542 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:52.168552 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:52.168676 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:52.168927 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 15:20:52.168975 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 15:20:52.170553 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:52.164083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45799 (local address 127.15.242.193:57075)
0807 15:20:52.164917 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:52.164963 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:52.166760 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:52.167406 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:52.167414 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:52.167512 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:52.168201 (+ 689us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:52.168202 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:52.168254 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:52.168331 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:52.168666 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:52.168676 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:52.168685 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 15:20:52.169356 (+ 671us) client_negotiation.cc:240] Negotiation successful
0807 15:20:52.169605 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":123,"threads_started":1}
I20260807 15:20:52.171978 31650 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45799
I20260807 15:20:52.172240 31650 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:52.172677 31650 heartbeater.cc:511] Master 127.15.242.254:45799 requested a full tablet report, sending...
I20260807 15:20:52.174396 31350 ts_manager.cc:194] Registered new tserver with Master: aa6867ad6be24f00b03479b45630873b (127.15.242.193:44707)
W20260807 15:20:52.293257 31654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:52.293541 31654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:52.293617 31654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:52.297653 31654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:52.297725 31654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:52.297807 31654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:52.302675 31654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:52.303785 31654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:52.305228 31654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:52.315872 31665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:52.315848 31663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:52.315837 31660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:52.316130 31654 server_base.cc:1034] running on GCE node
I20260807 15:20:52.316548 31654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:52.317415 31654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:52.318636 31654 hybrid_clock.cc:648] HybridClock initialized: now 1786116052318597 us; error 54 us; skew 500 ppm
I20260807 15:20:52.320832 31654 webserver.cc:460] Webserver started at http://127.15.242.194:34821/ using document root <none> and password file <none>
I20260807 15:20:52.321437 31654 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:52.321535 31654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:52.321772 31654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:52.326879 31654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "9d8b0394688749af881bf416d328daf5"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "d84c725a9cb953b9100ea41b79b6ec7b"
server_key_iv: "e4201d1c320f10b72423756b29369156"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.327553 31654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "9d8b0394688749af881bf416d328daf5"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "d84c725a9cb953b9100ea41b79b6ec7b"
server_key_iv: "e4201d1c320f10b72423756b29369156"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.331552 31654 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:52.334354 31675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.335662 31654 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 15:20:52.335804 31654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "9d8b0394688749af881bf416d328daf5"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "d84c725a9cb953b9100ea41b79b6ec7b"
server_key_iv: "e4201d1c320f10b72423756b29369156"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.335923 31654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:52.340699 31654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:52.341331 31654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:52.341518 31654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:52.342079 31654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:52.342993 31654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:52.343062 31654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.343142 31654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:52.343192 31654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.352283 31654 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:41835
I20260807 15:20:52.352357 31853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:41835 every 8 connection(s)
I20260807 15:20:52.353299 31654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:52.357990 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 31654
I20260807 15:20:52.358177 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:52.358531 16331 external_mini_cluster.cc:1428] Setting key f2665870b69379933a248e31539cc651
I20260807 15:20:52.359839 31411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:52.355207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:50835 (local address 127.15.242.254:45799)
0807 15:20:52.355353 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:52.355357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:52.356359 (+ 1002us) server_negotiation.cc:407] Connection header received
0807 15:20:52.357786 (+ 1427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:52.357789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:52.357835 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:52.357944 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:52.359274 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:52.359280 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:52.359283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:52.359300 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:52.359352 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:52.359365 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:52.359461 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:52.359665 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 15:20:52.359707 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:20:52.360880 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45799
--builtin_ntp_servers=127.15.242.212:35645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 15:20:52.360946 31858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:52.355560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45799 (local address 127.15.242.194:50835)
0807 15:20:52.356210 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:52.356249 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:52.357542 (+ 1293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:52.358154 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:52.358161 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:52.358289 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:52.358936 (+ 647us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:52.358938 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:52.358977 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:52.359045 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:52.359473 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:52.359483 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:52.359489 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 15:20:52.359670 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 15:20:52.359908 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":113,"threads_started":1}
I20260807 15:20:52.362155 31855 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45799
I20260807 15:20:52.362401 31855 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:52.362838 31855 heartbeater.cc:511] Master 127.15.242.254:45799 requested a full tablet report, sending...
I20260807 15:20:52.363925 31350 ts_manager.cc:194] Registered new tserver with Master: 9d8b0394688749af881bf416d328daf5 (127.15.242.194:41835)
W20260807 15:20:52.479959 31862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:52.480211 31862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:52.480250 31862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:52.484254 31862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:52.484308 31862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:52.484402 31862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:52.489270 31862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45799
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:52.490515 31862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:52.492050 31862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:52.502283 31873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:52.502291 31868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:52.502333 31862 server_base.cc:1034] running on GCE node
W20260807 15:20:52.502291 31870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:52.502923 31862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:52.503573 31862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:52.504829 31862 hybrid_clock.cc:648] HybridClock initialized: now 1786116052504804 us; error 29 us; skew 500 ppm
I20260807 15:20:52.512552 31862 webserver.cc:460] Webserver started at http://127.15.242.195:38845/ using document root <none> and password file <none>
I20260807 15:20:52.513239 31862 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:52.513339 31862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:52.513590 31862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:52.515734 31862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "d2a686f35acf4a6f8b54bdae7e3dbc10"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "5c05431d7d24348d119ccae9ff31977f"
server_key_iv: "61657be151e4af6534f2924771cbaad5"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.516321 31862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "d2a686f35acf4a6f8b54bdae7e3dbc10"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "5c05431d7d24348d119ccae9ff31977f"
server_key_iv: "61657be151e4af6534f2924771cbaad5"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.520074 31862 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 15:20:52.522805 31880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.524032 31862 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:52.524191 31862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "d2a686f35acf4a6f8b54bdae7e3dbc10"
format_stamp: "Formatted at 2026-08-07 15:20:52 on dist-test-slave-g170"
server_key: "5c05431d7d24348d119ccae9ff31977f"
server_key_iv: "61657be151e4af6534f2924771cbaad5"
server_key_version: "encryptionkey@0"
I20260807 15:20:52.524309 31862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:52.529202 31862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:52.529824 31862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:52.530014 31862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:52.530571 31862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:52.531541 31862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:52.531620 31862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.531690 31862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:52.531744 31862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:52.541546 31862 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:35139
I20260807 15:20:52.541576 32074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:35139 every 8 connection(s)
I20260807 15:20:52.542459 31862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:52.548741 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 31862
I20260807 15:20:52.548920 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:52.548924 31411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:52.544325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:55533 (local address 127.15.242.254:45799)
0807 15:20:52.544475 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:52.544479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:52.545563 (+ 1084us) server_negotiation.cc:407] Connection header received
0807 15:20:52.547037 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:52.547040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:52.547095 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:52.547183 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:52.548368 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:52.548372 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:52.548374 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:20:52.548386 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:52.548407 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:20:52.548417 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:52.548525 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:52.548702 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 15:20:52.548748 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 15:20:52.549243 16331 external_mini_cluster.cc:1428] Setting key 762f6937570e1ea73bb6e0c3d51bbd55
I20260807 15:20:52.549852 32078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:52.544708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45799 (local address 127.15.242.195:55533)
0807 15:20:52.545410 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:52.545451 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:52.546806 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:52.547367 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:52.547374 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:52.547462 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:52.548101 (+ 639us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:20:52.548103 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:52.548144 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:20:52.548213 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:52.548527 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:52.548540 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:52.548548 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 15:20:52.548734 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 15:20:52.549000 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":111,"threads_started":1}
I20260807 15:20:52.551064 32075 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45799
I20260807 15:20:52.551308 32075 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:52.551728 32075 heartbeater.cc:511] Master 127.15.242.254:45799 requested a full tablet report, sending...
I20260807 15:20:52.552827 31350 ts_manager.cc:194] Registered new tserver with Master: d2a686f35acf4a6f8b54bdae7e3dbc10 (127.15.242.195:35139)
I20260807 15:20:52.563333 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 15:20:52.566406 31411 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:20:52.565514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56354 (local address 127.15.242.254:45799)
0807 15:20:52.565788 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:52.565791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:52.565806 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:20:52.565927 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:52.565929 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:52.565964 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:52.566035 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:52.566269 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56354: BlockingRecv error: recv got EOF from 127.0.0.1:56354 (error 108)
Metrics: {"server-negotiator.queue_time_us":181}
I20260807 15:20:52.566516 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 31438
I20260807 15:20:52.588039 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 31654
I20260807 15:20:52.607519 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 31862
I20260807 15:20:52.618815 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 31308
2026-08-07T15:20:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (921 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:52 dist-test-slave-g170 krb5kdc[32087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:52 dist-test-slave-g170 krb5kdc[32087](info): set up 2 sockets
Aug 07 15:20:52 dist-test-slave-g170 krb5kdc[32087](info): commencing operation
krb5kdc: starting...
W20260807 15:20:53.922384 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:54 dist-test-slave-g170 krb5kdc[32087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:20:54.072554 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:34337
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:45173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:34337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:54.188572 32108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:54.188879 32108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:54.188963 32108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:54.192974 32108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:20:54.193058 32108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:54.193095 32108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:54.193131 32108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:20:54.193163 32108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:20:54.199040 32108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:34337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:34337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:54.200134 32108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:54.201222 32108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:54.209954 32123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:54.209995 32116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:54.210005 32121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:54.210134 32108 server_base.cc:1034] running on GCE node
I20260807 15:20:54.210834 32108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:54.211948 32108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:54.213142 32108 hybrid_clock.cc:648] HybridClock initialized: now 1786116054213125 us; error 29 us; skew 500 ppm
Aug 07 15:20:54 dist-test-slave-g170 krb5kdc[32087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:54.216104 32108 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:20:54.217037 32108 webserver.cc:460] Webserver started at http://127.15.242.254:40953/ using document root <none> and password file <none>
I20260807 15:20:54.217556 32108 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:54.217613 32108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:54.217789 32108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:54.219844 32108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "5446ae0a400c4c7b9897a12c994267dd"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "e8dbd104d6979781871eada33e89ba1e"
server_key_iv: "c7825527c22bc65ae53e7a283fac30a6"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.220373 32108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "5446ae0a400c4c7b9897a12c994267dd"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "e8dbd104d6979781871eada33e89ba1e"
server_key_iv: "c7825527c22bc65ae53e7a283fac30a6"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.224144 32108 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:20:54.226636 32132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:54.227885 32108 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:20:54.227984 32108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "5446ae0a400c4c7b9897a12c994267dd"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "e8dbd104d6979781871eada33e89ba1e"
server_key_iv: "c7825527c22bc65ae53e7a283fac30a6"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.228067 32108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:54.248426 32108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:54.251796 32108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:54.251950 32108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:54.259299 32108 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:34337
I20260807 15:20:54.259649 32214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:34337 every 8 connection(s)
I20260807 15:20:54.260372 32108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:20:54.263219 32216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:54.269141 32216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd: Bootstrap starting.
I20260807 15:20:54.269973 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 32108
I20260807 15:20:54.270141 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:20:54.270534 16331 external_mini_cluster.cc:1428] Setting key c2f1fb2efcbdbdabad34878914a39034
I20260807 15:20:54.272652 32216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:54.273618 32216 log.cc:824] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:54.276252 32216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd: No bootstrap required, opened a new log
I20260807 15:20:54.281495 32216 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5446ae0a400c4c7b9897a12c994267dd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34337 } }
I20260807 15:20:54.281738 32216 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:54.281778 32216 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5446ae0a400c4c7b9897a12c994267dd, State: Initialized, Role: FOLLOWER
I20260807 15:20:54.282377 32216 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5446ae0a400c4c7b9897a12c994267dd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34337 } }
I20260807 15:20:54.282579 32216 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:20:54.282678 32216 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:20:54.282801 32216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 0 FOLLOWER]: Advancing to term 1
Aug 07 15:20:54 dist-test-slave-g170 krb5kdc[32087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:54.284070 32216 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5446ae0a400c4c7b9897a12c994267dd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34337 } }
I20260807 15:20:54.284466 32216 leader_election.cc:302] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5446ae0a400c4c7b9897a12c994267dd; no voters:
I20260807 15:20:54.284936 32216 leader_election.cc:288] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:20:54.285017 32225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:54.285251 32225 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [term 1 LEADER]: Becoming Leader. State: Replica: 5446ae0a400c4c7b9897a12c994267dd, State: Running, Role: LEADER
I20260807 15:20:54.285579 32225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5446ae0a400c4c7b9897a12c994267dd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34337 } }
I20260807 15:20:54.286381 32216 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:20:54.287366 32227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5446ae0a400c4c7b9897a12c994267dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5446ae0a400c4c7b9897a12c994267dd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34337 } } }
I20260807 15:20:54.287515 32227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:54.287886 32229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5446ae0a400c4c7b9897a12c994267dd. Latest consensus state: current_term: 1 leader_uuid: "5446ae0a400c4c7b9897a12c994267dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5446ae0a400c4c7b9897a12c994267dd" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34337 } } }
I20260807 15:20:54.287976 32229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd [sys.catalog]: This master's current role is: LEADER
I20260807 15:20:54.288898 32239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:20:54.290040 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:54.272184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38230 (local address 127.15.242.254:34337)
0807 15:20:54.272693 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:54.272720 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:54.272800 (+ 80us) server_negotiation.cc:407] Connection header received
0807 15:20:54.273860 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:54.273887 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:54.274396 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:54.275847 (+ 1451us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:54.276336 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.277975 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.279376 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.280293 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.280475 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:54.283563 (+ 3088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:54.283571 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:54.283585 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:54.283629 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:54.285944 (+ 2315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:54.286429 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:54.286436 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:54.286442 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:54.286598 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:54.286932 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:54.286935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:54.286936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:54.287465 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:54.287646 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:54.288755 (+ 1109us) server_negotiation.cc:299] Negotiation successful
0807 15:20:54.289091 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":130,"threads_started":1}
I20260807 15:20:54.292210 32239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:20:54.298785 32239 catalog_manager.cc:1347] Generated new cluster ID: 6f8c9fc683ea40ba81f516faa4c96531
I20260807 15:20:54.298864 32239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:20:54.311947 32239 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:20:54.313429 32239 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:20:54.323630 32239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd: Generated new TSK 0
I20260807 15:20:54.324574 32239 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:20:54.360284 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34337
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:45173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:54.485386 32260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:54.485708 32260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:54.485796 32260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:54.490152 32260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:54.490235 32260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:54.490327 32260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:20:54.495507 32260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:54.496615 32260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:54.497762 32260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:54.508050 32269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:54.508121 32268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:54.508133 32272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:54.508337 32260 server_base.cc:1034] running on GCE node
I20260807 15:20:54.508701 32260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:54.509557 32260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:54.510777 32260 hybrid_clock.cc:648] HybridClock initialized: now 1786116054510739 us; error 45 us; skew 500 ppm
Aug 07 15:20:54 dist-test-slave-g170 krb5kdc[32087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:54.513674 32260 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:20:54.514611 32260 webserver.cc:460] Webserver started at http://127.15.242.193:37127/ using document root <none> and password file <none>
I20260807 15:20:54.515185 32260 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:54.515276 32260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:54.515516 32260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:54.517638 32260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "c998127605ee46589cfac7c3cf8062b5"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "8efbab05891286dfc6bfa14274d3c85b"
server_key_iv: "87073c71d2aa6c2eb117a658011df09a"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.518226 32260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "c998127605ee46589cfac7c3cf8062b5"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "8efbab05891286dfc6bfa14274d3c85b"
server_key_iv: "87073c71d2aa6c2eb117a658011df09a"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.522076 32260 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:20:54.524565 32279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:54.525990 32260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:20:54.526175 32260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "c998127605ee46589cfac7c3cf8062b5"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "8efbab05891286dfc6bfa14274d3c85b"
server_key_iv: "87073c71d2aa6c2eb117a658011df09a"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.526298 32260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:54.558214 32260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:54.561342 32260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:54.561563 32260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:54.562203 32260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:54.563090 32260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:54.563172 32260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:54.563246 32260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:54.563289 32260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:54.573202 32260 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:46701
I20260807 15:20:54.573237 32465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:46701 every 8 connection(s)
I20260807 15:20:54.574131 32260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:20:54.579314 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 32260
I20260807 15:20:54.579442 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:20:54.579850 16331 external_mini_cluster.cc:1428] Setting key a4d1812fa338acf5ec958b685ef9e271
Aug 07 15:20:54 dist-test-slave-g170 krb5kdc[32087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:54.590019 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:54.575951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:37989 (local address 127.15.242.254:34337)
0807 15:20:54.576087 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:54.576092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:54.576897 (+ 805us) server_negotiation.cc:407] Connection header received
0807 15:20:54.578282 (+ 1385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:54.578285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:54.578348 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:54.578429 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:54.580077 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.580796 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.582509 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.582817 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.582919 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:54.585903 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:54.585907 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:54.585909 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:54.585965 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:54.587556 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:54.588276 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:54.588279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:54.588280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:54.588359 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:54.588827 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:54.588830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:54.588831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:54.589048 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:54.589128 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:54.589797 (+ 669us) server_negotiation.cc:299] Negotiation successful
0807 15:20:54.589897 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 15:20:54.591271 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:54.576252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34337 (local address 127.15.242.193:37989)
0807 15:20:54.576715 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:54.576776 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:54.578070 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:54.578631 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:54.578640 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:54.579095 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:54.579838 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:54.579862 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.580956 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.580959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:54.582351 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:54.582367 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.582990 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.582996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:54.583243 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:54.584028 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:54.584044 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:54.585711 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:54.587692 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:54.587702 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:54.587721 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:54.588170 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:54.588463 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:54.588469 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:54.588471 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:54.588679 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:54.589175 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:54.589185 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:54.589515 (+ 330us) client_negotiation.cc:769] Sending connection context
0807 15:20:54.589741 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 15:20:54.590107 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:20:54.592615 32467 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34337
I20260807 15:20:54.593063 32467 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:54.593575 32467 heartbeater.cc:511] Master 127.15.242.254:34337 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:20:54.595278 32160 ts_manager.cc:194] Registered new tserver with Master: c998127605ee46589cfac7c3cf8062b5 (127.15.242.193:46701)
I20260807 15:20:54.596417 32160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:37989
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:20:54.612752 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34337
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:45173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:54.729198 32478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:54.729537 32478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:54.729619 32478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:54.734020 32478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:54.734117 32478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:54.734216 32478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:20:54.739820 32478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:54.741029 32478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:54.742091 32478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:54.752318 32485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:54.752540 32478 server_base.cc:1034] running on GCE node
W20260807 15:20:54.752372 32484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:54.752327 32487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:54.753144 32478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:54.753883 32478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:54.755079 32478 hybrid_clock.cc:648] HybridClock initialized: now 1786116054755053 us; error 37 us; skew 500 ppm
Aug 07 15:20:54 dist-test-slave-g170 krb5kdc[32087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:54.758126 32478 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:20:54.759202 32478 webserver.cc:460] Webserver started at http://127.15.242.194:36709/ using document root <none> and password file <none>
I20260807 15:20:54.759850 32478 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:54.759955 32478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:54.760219 32478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:54.762471 32478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "b602bc35df9e4b92b12e658d1db105b7"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "e70ed16ae1600e7bea199d84b254f26b"
server_key_iv: "09a0f76621e9032059355722b8287798"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.763100 32478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "b602bc35df9e4b92b12e658d1db105b7"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "e70ed16ae1600e7bea199d84b254f26b"
server_key_iv: "09a0f76621e9032059355722b8287798"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.767289 32478 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:20:54.770172 32495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:54.771416 32478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:20:54.771565 32478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "b602bc35df9e4b92b12e658d1db105b7"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "e70ed16ae1600e7bea199d84b254f26b"
server_key_iv: "09a0f76621e9032059355722b8287798"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.771737 32478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:54.781658 32478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:54.784737 32478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:54.785037 32478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:54.785693 32478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:54.786648 32478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:54.786731 32478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:54.786798 32478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:54.786836 32478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:54.798197 32478 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:34273
I20260807 15:20:54.798310 32666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:34273 every 8 connection(s)
I20260807 15:20:54.799288 32478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:20:54.800128 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 32478
I20260807 15:20:54.800235 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:20:54.800637 16331 external_mini_cluster.cc:1428] Setting key cd24fb40cb4a2451c033b7ae987ed841
Aug 07 15:20:54 dist-test-slave-g170 krb5kdc[32087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:20:54.815537 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:54.801493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:50299 (local address 127.15.242.254:34337)
0807 15:20:54.802154 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:54.802159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:54.802783 (+ 624us) server_negotiation.cc:407] Connection header received
0807 15:20:54.804231 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:54.804238 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:54.804304 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:54.804411 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:54.805721 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.806234 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.808026 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.808244 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.808331 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:54.811767 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:54.811771 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:54.811773 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:54.811797 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:54.813404 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:54.813931 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:54.813935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:54.813937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:54.814022 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:54.814412 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:54.814415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:54.814417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:54.814603 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:54.814719 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:54.815239 (+ 520us) server_negotiation.cc:299] Negotiation successful
0807 15:20:54.815362 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:20:54.816711 32672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:54.802034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34337 (local address 127.15.242.194:50299)
0807 15:20:54.802599 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:54.802654 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:54.804013 (+ 1359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:54.804550 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:54.804556 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:54.805032 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:54.805541 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:54.805555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.806382 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.806388 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:54.807892 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:54.807907 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:54.808415 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:54.808423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:54.808671 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:54.809506 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:54.809528 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:54.811558 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:54.813522 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:54.813528 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:54.813543 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:54.813819 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:54.814153 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:54.814156 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:54.814158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:54.814305 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:54.814721 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:54.814729 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:54.814978 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 15:20:54.815172 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 15:20:54.815606 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":182,"threads_started":1}
I20260807 15:20:54.817982 32667 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34337
I20260807 15:20:54.818238 32667 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:54.818778 32667 heartbeater.cc:511] Master 127.15.242.254:34337 requested a full tablet report, sending...
I20260807 15:20:54.819903 32160 ts_manager.cc:194] Registered new tserver with Master: b602bc35df9e4b92b12e658d1db105b7 (127.15.242.194:34273)
I20260807 15:20:54.820521 32160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:50299
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:20:54.835903 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34337
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:45173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:20:54.953269 32676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:20:54.953596 32676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:20:54.953693 32676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:20:54.958355 32676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:20:54.958457 32676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:20:54.958559 32676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:20:54.964661 32676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:45173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:20:54.966090 32676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:20:54.967306 32676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:20:54.977850 32689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:54.977850 32685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:20:54.977861 32684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:20:54.978137 32676 server_base.cc:1034] running on GCE node
I20260807 15:20:54.978662 32676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:20:54.979367 32676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:20:54.980541 32676 hybrid_clock.cc:648] HybridClock initialized: now 1786116054980518 us; error 38 us; skew 500 ppm
Aug 07 15:20:54 dist-test-slave-g170 krb5kdc[32087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:20:54.983731 32676 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:20:54.984694 32676 webserver.cc:460] Webserver started at http://127.15.242.195:38883/ using document root <none> and password file <none>
I20260807 15:20:54.985394 32676 fs_manager.cc:359] Metadata directory not provided
I20260807 15:20:54.985462 32676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:20:54.985697 32676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:20:54.988178 32676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "44efb26c2b544f3c0bb37da1ca37d70b"
server_key_iv: "1c83fcac37ee32b887574954d3f0ebe1"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.988848 32676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "44efb26c2b544f3c0bb37da1ca37d70b"
server_key_iv: "1c83fcac37ee32b887574954d3f0ebe1"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.992990 32676 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:20:54.996035 32697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:54.997588 32676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:20:54.997745 32676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc"
format_stamp: "Formatted at 2026-08-07 15:20:54 on dist-test-slave-g170"
server_key: "44efb26c2b544f3c0bb37da1ca37d70b"
server_key_iv: "1c83fcac37ee32b887574954d3f0ebe1"
server_key_version: "encryptionkey@0"
I20260807 15:20:54.997872 32676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:20:55.016350 32676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:20:55.020255 32676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:20:55.020509 32676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:20:55.021279 32676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:20:55.022214 32676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:20:55.022289 32676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:55.022373 32676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:20:55.022418 32676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:20:55.032483 32676 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:36141
I20260807 15:20:55.032509 386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:36141 every 8 connection(s)
I20260807 15:20:55.033514 32676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:20:55.034111 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 32676
I20260807 15:20:55.034252 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:20:55.034610 16331 external_mini_cluster.cc:1428] Setting key 6ec59846017e65162199578be01dfd21
Aug 07 15:20:55 dist-test-slave-g170 krb5kdc[32087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:20:55.049438 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.035595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:58179 (local address 127.15.242.254:34337)
0807 15:20:55.035777 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:55.035781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:55.036743 (+ 962us) server_negotiation.cc:407] Connection header received
0807 15:20:55.038290 (+ 1547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:55.038293 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:55.038356 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:55.038448 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:55.039819 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.040418 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.041721 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.041977 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.042080 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.045031 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:55.045035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:55.045037 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:55.045065 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:55.046784 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:55.047353 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:55.047357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:55.047359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:55.047462 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:55.047932 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:55.047936 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:55.047938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:55.048224 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:55.048337 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:55.049093 (+ 756us) server_negotiation.cc:299] Negotiation successful
0807 15:20:55.049269 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 15:20:55.050204 390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.036042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34337 (local address 127.15.242.195:58179)
0807 15:20:55.036545 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:55.036603 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:55.038057 (+ 1454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:55.038637 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:55.038646 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:55.039116 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:20:55.039660 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.039673 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.040537 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.040540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.041565 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.041576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.042134 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.042138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.042297 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.042955 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:20:55.042971 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:20:55.044864 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:20:55.046901 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:55.046906 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:55.046919 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:55.047190 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:55.047582 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:20:55.047632 (+ 50us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:20:55.047638 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:20:55.047811 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:20:55.048348 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:20:55.048354 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:20:55.048742 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 15:20:55.048982 (+ 240us) client_negotiation.cc:240] Negotiation successful
0807 15:20:55.049355 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":120,"threads_started":1}
I20260807 15:20:55.051414 387 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34337
I20260807 15:20:55.051730 387 heartbeater.cc:464] Registering TS with master...
I20260807 15:20:55.052253 387 heartbeater.cc:511] Master 127.15.242.254:34337 requested a full tablet report, sending...
I20260807 15:20:55.053395 32160 ts_manager.cc:194] Registered new tserver with Master: 4b4307f30b3a487e88ad60e0ff9ab3cc (127.15.242.195:36141)
I20260807 15:20:55.054013 32160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:58179
I20260807 15:20:55.061178 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:20:55.071308 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.063254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38232 (local address 127.15.242.254:34337)
0807 15:20:55.063390 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:55.063394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:55.063592 (+ 198us) server_negotiation.cc:407] Connection header received
0807 15:20:55.063733 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:55.063735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:55.063779 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:55.063848 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:20:55.064515 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.065130 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.065955 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.066278 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.066365 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.067940 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:20:55.067944 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:20:55.067946 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:20:55.067971 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:20:55.069541 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:55.069981 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:55.069984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:55.069986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:55.070084 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:20:55.070414 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:20:55.070417 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:20:55.070418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:20:55.070647 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:20:55.070812 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:55.071061 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 15:20:55.071170 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 15:20:55.074673 32160 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38232:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:20:55.078310 32160 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:20:55.095008 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.087867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:36141 (local address 127.0.0.1:34146)
0807 15:20:55.088416 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:55.088470 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:55.088635 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:55.089888 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:55.089892 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:55.089928 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:55.090141 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.090148 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.091885 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.091890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.093322 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.093332 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.094478 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.094481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.094574 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.094617 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 15:20:55.094719 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 15:20:55.094807 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":121,"spinlock_wait_cycles":3328,"thread_start_us":126,"threads_started":1}
I20260807 15:20:55.095075 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.088008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34146 (local address 127.15.242.195:36141)
0807 15:20:55.089347 (+ 1339us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:55.089359 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:55.089379 (+ 20us) server_negotiation.cc:407] Connection header received
0807 15:20:55.089488 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:55.089493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:55.089693 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:55.090335 (+ 642us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:55.090480 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.091710 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.093459 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.094284 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.094426 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.094569 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:55.094786 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 15:20:55.094896 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1172,"thread_start_us":144,"threads_started":1}
I20260807 15:20:55.095711 402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.087986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:46701 (local address 127.0.0.1:60522)
0807 15:20:55.088901 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:55.088917 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:55.089033 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:55.089871 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:55.089880 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:55.089922 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:55.090142 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.090150 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.091803 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.091810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.093697 (+ 1887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.093709 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.094896 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.094900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.094998 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.095026 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 15:20:55.095491 (+ 465us) client_negotiation.cc:240] Negotiation successful
0807 15:20:55.095570 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"mutex_wait_us":237,"spinlock_wait_cycles":2816,"thread_start_us":132,"threads_started":1}
I20260807 15:20:55.096419 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.088661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60522 (local address 127.15.242.193:46701)
0807 15:20:55.089071 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:55.089091 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:55.089119 (+ 28us) server_negotiation.cc:407] Connection header received
0807 15:20:55.089210 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:55.089216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:55.089454 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:55.089633 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:55.090281 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.091653 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.093836 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.094753 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.094891 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.095022 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:55.096188 (+ 1166us) server_negotiation.cc:299] Negotiation successful
0807 15:20:55.096283 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":157,"threads_started":1}
I20260807 15:20:55.096858 407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.088707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:34273 (local address 127.0.0.1:46968)
0807 15:20:55.089871 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:55.089884 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:55.089979 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:55.090521 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:55.090524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:55.090544 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:55.090641 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.090647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.091905 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.091911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.093696 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.093709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.096381 (+ 2672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.096384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.096456 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.096511 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 15:20:55.096597 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 15:20:55.096671 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1096,"mutex_wait_us":208,"thread_start_us":159,"threads_started":1}
I20260807 15:20:55.097357 409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.089255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46968 (local address 127.15.242.194:34273)
0807 15:20:55.089606 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:55.089618 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:55.090096 (+ 478us) server_negotiation.cc:407] Connection header received
0807 15:20:55.090198 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:55.090206 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:55.090383 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:55.090547 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:55.090758 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.091575 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.095094 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.096046 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.096177 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.096311 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:55.097059 (+ 748us) server_negotiation.cc:299] Negotiation successful
0807 15:20:55.097190 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":114,"threads_started":1}
I20260807 15:20:55.098569 32763 tablet_service.cc:1467] Processing CreateTablet for tablet ffcee4919a894b9a93701f65fe7193a6 (DEFAULT_TABLE table=test-table [id=3717e63f3f1d4c9096383a3933dedaa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:55.098915 32363 tablet_service.cc:1467] Processing CreateTablet for tablet ffcee4919a894b9a93701f65fe7193a6 (DEFAULT_TABLE table=test-table [id=3717e63f3f1d4c9096383a3933dedaa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:55.099761 32763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffcee4919a894b9a93701f65fe7193a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:55.099869 32363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffcee4919a894b9a93701f65fe7193a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:55.100011 32572 tablet_service.cc:1467] Processing CreateTablet for tablet ffcee4919a894b9a93701f65fe7193a6 (DEFAULT_TABLE table=test-table [id=3717e63f3f1d4c9096383a3933dedaa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:20:55.101001 32572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffcee4919a894b9a93701f65fe7193a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:20:55.107112 410 tablet_bootstrap.cc:492] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5: Bootstrap starting.
I20260807 15:20:55.108481 412 tablet_bootstrap.cc:492] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: Bootstrap starting.
I20260807 15:20:55.109148 413 tablet_bootstrap.cc:492] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: Bootstrap starting.
I20260807 15:20:55.109670 410 tablet_bootstrap.cc:654] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:55.110577 410 log.cc:824] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:55.110792 412 tablet_bootstrap.cc:654] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:55.111804 413 tablet_bootstrap.cc:654] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: Neither blocks nor log segments found. Creating new log.
I20260807 15:20:55.112334 412 log.cc:824] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:55.112601 413 log.cc:824] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: Log is configured to *not* fsync() on all Append() calls
I20260807 15:20:55.113171 410 tablet_bootstrap.cc:492] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5: No bootstrap required, opened a new log
I20260807 15:20:55.113391 410 ts_tablet_manager.cc:1397] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:20:55.114466 413 tablet_bootstrap.cc:492] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: No bootstrap required, opened a new log
I20260807 15:20:55.114470 412 tablet_bootstrap.cc:492] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: No bootstrap required, opened a new log
I20260807 15:20:55.114670 413 ts_tablet_manager.cc:1397] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 15:20:55.114799 412 ts_tablet_manager.cc:1397] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:20:55.117357 410 raft_consensus.cc:348] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.117616 410 raft_consensus.cc:374] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:55.117676 410 raft_consensus.cc:729] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c998127605ee46589cfac7c3cf8062b5, State: Initialized, Role: FOLLOWER
I20260807 15:20:55.118184 410 consensus_queue.cc:260] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.118845 412 raft_consensus.cc:348] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.118845 413 raft_consensus.cc:348] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.119102 413 raft_consensus.cc:374] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:55.119102 412 raft_consensus.cc:374] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:20:55.119168 412 raft_consensus.cc:729] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b4307f30b3a487e88ad60e0ff9ab3cc, State: Initialized, Role: FOLLOWER
I20260807 15:20:55.119168 413 raft_consensus.cc:729] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b602bc35df9e4b92b12e658d1db105b7, State: Initialized, Role: FOLLOWER
I20260807 15:20:55.119438 410 ts_tablet_manager.cc:1428] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:20:55.119623 413 consensus_queue.cc:260] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.119613 412 consensus_queue.cc:260] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.119875 32467 heartbeater.cc:503] Master 127.15.242.254:34337 was elected leader, sending a full tablet report...
I20260807 15:20:55.120565 413 ts_tablet_manager.cc:1428] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 15:20:55.120565 412 ts_tablet_manager.cc:1428] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:20:55.120626 32667 heartbeater.cc:503] Master 127.15.242.254:34337 was elected leader, sending a full tablet report...
I20260807 15:20:55.121052 387 heartbeater.cc:503] Master 127.15.242.254:34337 was elected leader, sending a full tablet report...
I20260807 15:20:55.208868 418 raft_consensus.cc:482] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:20:55.209144 418 raft_consensus.cc:504] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.210659 418 leader_election.cc:288] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b4307f30b3a487e88ad60e0ff9ab3cc (127.15.242.195:36141), b602bc35df9e4b92b12e658d1db105b7 (127.15.242.194:34273)
I20260807 15:20:55.215081 409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.211264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:60357 (local address 127.15.242.194:34273)
0807 15:20:55.211416 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:55.211420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:55.211434 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:20:55.211588 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:55.211592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:55.211718 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:55.211805 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:55.212183 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.212872 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.214044 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.214465 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.214563 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.214655 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:55.214855 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 15:20:55.214934 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:20:55.215104 404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.211180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:54683 (local address 127.15.242.195:36141)
0807 15:20:55.211345 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:55.211350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:55.211828 (+ 478us) server_negotiation.cc:407] Connection header received
0807 15:20:55.211890 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:55.211893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:55.211941 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:55.212034 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:20:55.212335 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.212877 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.214102 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.214495 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.214633 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.214688 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:55.214902 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 15:20:55.214978 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 15:20:55.215119 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.210930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:34273 (local address 127.15.242.193:60357)
0807 15:20:55.211307 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:55.211324 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:55.211445 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:55.211860 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:55.211865 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:55.211890 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:55.212054 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.212062 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.212990 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.212995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.213919 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.213930 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.214599 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.214603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.214713 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.214738 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 15:20:55.214813 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 15:20:55.214914 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":7,"thread_start_us":138,"threads_started":1}
I20260807 15:20:55.215123 425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.210930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:36141 (local address 127.15.242.193:54683)
0807 15:20:55.211670 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:55.211684 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:20:55.211797 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:20:55.212051 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:20:55.212054 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:20:55.212069 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:20:55.212220 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.212227 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.213008 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.213016 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.213948 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:20:55.213958 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.214644 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.214647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:20:55.214751 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.214769 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 15:20:55.214866 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 15:20:55.214933 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"mutex_wait_us":505,"thread_start_us":131,"threads_started":1}
I20260807 15:20:55.215797 327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffcee4919a894b9a93701f65fe7193a6" candidate_uuid: "c998127605ee46589cfac7c3cf8062b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" is_pre_election: true
I20260807 15:20:55.216008 32604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffcee4919a894b9a93701f65fe7193a6" candidate_uuid: "c998127605ee46589cfac7c3cf8062b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b602bc35df9e4b92b12e658d1db105b7" is_pre_election: true
I20260807 15:20:55.216157 327 raft_consensus.cc:2454] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c998127605ee46589cfac7c3cf8062b5 in term 0.
I20260807 15:20:55.216378 32604 raft_consensus.cc:2454] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c998127605ee46589cfac7c3cf8062b5 in term 0.
I20260807 15:20:55.216724 32280 leader_election.cc:302] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b4307f30b3a487e88ad60e0ff9ab3cc, c998127605ee46589cfac7c3cf8062b5; no voters:
I20260807 15:20:55.217087 418 raft_consensus.cc:2781] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:20:55.217180 418 raft_consensus.cc:482] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:20:55.217233 418 raft_consensus.cc:3037] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:55.218422 418 raft_consensus.cc:504] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.218995 418 leader_election.cc:288] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [CANDIDATE]: Term 1 election: Requested vote from peers 4b4307f30b3a487e88ad60e0ff9ab3cc (127.15.242.195:36141), b602bc35df9e4b92b12e658d1db105b7 (127.15.242.194:34273)
I20260807 15:20:55.219435 327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffcee4919a894b9a93701f65fe7193a6" candidate_uuid: "c998127605ee46589cfac7c3cf8062b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc"
I20260807 15:20:55.219612 327 raft_consensus.cc:3037] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:55.219547 32604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffcee4919a894b9a93701f65fe7193a6" candidate_uuid: "c998127605ee46589cfac7c3cf8062b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b602bc35df9e4b92b12e658d1db105b7"
I20260807 15:20:55.219749 32604 raft_consensus.cc:3037] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:20:55.220839 327 raft_consensus.cc:2454] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c998127605ee46589cfac7c3cf8062b5 in term 1.
I20260807 15:20:55.220981 32604 raft_consensus.cc:2454] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c998127605ee46589cfac7c3cf8062b5 in term 1.
I20260807 15:20:55.221153 32280 leader_election.cc:302] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b4307f30b3a487e88ad60e0ff9ab3cc, c998127605ee46589cfac7c3cf8062b5; no voters:
I20260807 15:20:55.221338 418 raft_consensus.cc:2781] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:20:55.221572 418 raft_consensus.cc:686] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [term 1 LEADER]: Becoming Leader. State: Replica: c998127605ee46589cfac7c3cf8062b5, State: Running, Role: LEADER
I20260807 15:20:55.221968 418 consensus_queue.cc:237] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } }
I20260807 15:20:55.225339 32159 catalog_manager.cc:5495] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c998127605ee46589cfac7c3cf8062b5 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "c998127605ee46589cfac7c3cf8062b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c998127605ee46589cfac7c3cf8062b5" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 } health_report { overall_health: UNKNOWN } } }
I20260807 15:20:55.249301 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.245615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60530 (local address 127.15.242.193:46701)
0807 15:20:55.245811 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 15:20:55.245815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:20:55.245830 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:20:55.245902 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:20:55.245904 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:20:55.245959 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:20:55.246053 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:20:55.246298 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.246790 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.247659 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:20:55.247896 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:20:55.247983 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:20:55.248326 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:20:55.248836 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:20:55.248945 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 15:20:55.249063 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 15:20:55.249117 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 15:20:55.255141 32604 raft_consensus.cc:1261] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 1 FOLLOWER]: Refusing update from remote peer c998127605ee46589cfac7c3cf8062b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:55.255227 327 raft_consensus.cc:1261] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 1 FOLLOWER]: Refusing update from remote peer c998127605ee46589cfac7c3cf8062b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:20:55.256033 418 consensus_queue.cc:1035] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b4307f30b3a487e88ad60e0ff9ab3cc" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 36141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:55.256269 428 consensus_queue.cc:1035] T ffcee4919a894b9a93701f65fe7193a6 P c998127605ee46589cfac7c3cf8062b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b602bc35df9e4b92b12e658d1db105b7" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:20:55.264829 433 mvcc.cc:205] Tried to move back new op lower bound from 7315931362317840384 to 7315931362192158720. Current Snapshot: MvccSnapshot[applied={T|T < 7315931362317840384}]
I20260807 15:20:55.265040 431 mvcc.cc:205] Tried to move back new op lower bound from 7315931362317840384 to 7315931362192158720. Current Snapshot: MvccSnapshot[applied={T|T < 7315931362317840384}]
I20260807 15:20:55.274725 32158 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:55.274894 32158 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:20:55.277576 32158 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5446ae0a400c4c7b9897a12c994267dd: Sending DeleteTablet for 3 replicas of tablet ffcee4919a894b9a93701f65fe7193a6
I20260807 15:20:55.278482 32763 tablet_service.cc:1514] Processing DeleteTablet for tablet ffcee4919a894b9a93701f65fe7193a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:55 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:34146
I20260807 15:20:55.278534 32363 tablet_service.cc:1514] Processing DeleteTablet for tablet ffcee4919a894b9a93701f65fe7193a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:55 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:60522
I20260807 15:20:55.278575 32572 tablet_service.cc:1514] Processing DeleteTablet for tablet ffcee4919a894b9a93701f65fe7193a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:20:55 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:46968
I20260807 15:20:55.278988 450 tablet_replica.cc:330] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: stopping tablet replica
I20260807 15:20:55.279357 450 raft_consensus.cc:2229] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:55.279640 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 32260
I20260807 15:20:55.283965 452 tablet_replica.cc:330] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: stopping tablet replica
I20260807 15:20:55.284297 452 raft_consensus.cc:2229] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:20:55.284584 452 raft_consensus.cc:2258] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:55.291370 450 raft_consensus.cc:2258] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:20:55.292943 452 ts_tablet_manager.cc:1905] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:55.293141 450 ts_tablet_manager.cc:1905] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:20:55.295521 452 ts_tablet_manager.cc:1918] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:55.295665 452 log.cc:1196] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/ffcee4919a894b9a93701f65fe7193a6
I20260807 15:20:55.296027 452 ts_tablet_manager.cc:1939] T ffcee4919a894b9a93701f65fe7193a6 P 4b4307f30b3a487e88ad60e0ff9ab3cc: Deleting consensus metadata
I20260807 15:20:55.296733 450 ts_tablet_manager.cc:1918] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:20:55.296881 450 log.cc:1196] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/ffcee4919a894b9a93701f65fe7193a6
I20260807 15:20:55.297209 450 ts_tablet_manager.cc:1939] T ffcee4919a894b9a93701f65fe7193a6 P b602bc35df9e4b92b12e658d1db105b7: Deleting consensus metadata
I20260807 15:20:55.297447 32134 catalog_manager.cc:4841] TS 4b4307f30b3a487e88ad60e0ff9ab3cc (127.15.242.195:36141): tablet ffcee4919a894b9a93701f65fe7193a6 (table test-table [id=3717e63f3f1d4c9096383a3933dedaa1]) successfully deleted
I20260807 15:20:55.298493 32139 catalog_manager.cc:4841] TS b602bc35df9e4b92b12e658d1db105b7 (127.15.242.194:34273): tablet ffcee4919a894b9a93701f65fe7193a6 (table test-table [id=3717e63f3f1d4c9096383a3933dedaa1]) successfully deleted
W20260807 15:20:55.299765 32139 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:46701 (error 108)
I20260807 15:20:55.299962 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 32478
I20260807 15:20:55.306968 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:20:55.306669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:46701 (local address 127.0.0.1:60542)
0807 15:20:55.306816 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 15:20:55.306888 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:46701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 15:20:55.307171 32139 catalog_manager.cc:4584] TS c998127605ee46589cfac7c3cf8062b5 (127.15.242.193:46701): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ffcee4919a894b9a93701f65fe7193a6: Network error: Client connection negotiation failed: client connection to 127.15.242.193:46701: connect: Connection refused (error 111)
I20260807 15:20:55.312203 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 32676
I20260807 15:20:55.324218 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 32108
2026-08-07T15:20:55Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2708 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:20:55 dist-test-slave-g170 krb5kdc[459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:20:55 dist-test-slave-g170 krb5kdc[459](info): set up 2 sockets
Aug 07 15:20:55 dist-test-slave-g170 krb5kdc[459](info): commencing operation
krb5kdc: starting...
W20260807 15:20:56.575037 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:20:56 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:20:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:20:56Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/rangeradmin_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/rangeradmin_127.15.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/rangerlookup_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/rangerlookup_127.15.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/HTTP_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/HTTP_127.15.242.212@KRBTEST.COM.keytab.
I20260807 15:20:56.766147 16331 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskB0Q6oi/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/postgres -l logfile start
2026-08-07 15:20:59.477 UTC [504] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 15:20:59.477 UTC [504] LOG: listening on IPv4 address "127.15.242.212", port 47701
2026-08-07 15:20:59.481 UTC [504] LOG: listening on Unix socket "/tmp/.s.PGSQL.47701"
2026-08-07 15:20:59.503 UTC [510] LOG: database system was shut down at 2026-08-07 15:20:57 UTC
2026-08-07 15:20:59.507 UTC [504] LOG: database system is ready to accept connections
I20260807 15:21:00.687428 16331 mini_postgres.cc:96] Postgres bound to 47701
2026-08-07 15:21:00.697 UTC [519] FATAL: database "slave" does not exist
127.15.242.212:47701 - accepting connections
I20260807 15:21:00.698062 16331 mini_ranger.cc:161] Starting Ranger...
I20260807 15:21:00.716517 16331 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 15:21:01.237330 16331 mini_ranger.cc:87] Created ranger Postgres database
I20260807 15:21:01.237444 16331 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-admin
2026-08-07 15:21:01,573 [I] DB FLAVOR :POSTGRES
2026-08-07 15:21:01,573 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 15:21:01,573 [I] Checking connection..
2026-08-07 15:21:01,574 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 15:21:01,851 [I] Checking connection passed.
2026-08-07 15:21:01,851 [I] --------- Verifying version history table ---------
2026-08-07 15:21:01,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 15:21:02,140 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 15:21:02,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 15:21:02,428 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 15:21:02,428 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 15:21:02,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 15:21:02.707 UTC [615] WARNING: there is no transaction in progress
2026-08-07 15:21:02,715 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 15:21:02,716 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 15:21:02,973 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 15:21:02,973 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 15:21:02,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 15:21:03,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 15:21:03,516 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-g170.c.gcp-upstream.internal','N') ;"
2026-08-07 15:21:03,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 15:21:04,058 [I] Table x_portal_user does not exist in database ranger
2026-08-07 15:21:04,058 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 15:21:04,333 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 15:21:04,333 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 15:21:04,583 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 15:21:04,832 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 15:21:04,833 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 15:21:05.894 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:05.912 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:05.930 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:05.946 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:05.966 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:05.984 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.044 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.052 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.067 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.078 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.089 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.103 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.113 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.120 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.128 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06.135 UTC [771] WARNING: there is no transaction in progress
2026-08-07 15:21:06,853 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 15:21:06,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 15:21:07,107 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 15:21:07,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 15:21:07,408 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 15:21:07,408 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 15:21:07,686 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 15:21:07,686 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 15:21:07,948 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 15:21:08,214 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-g170.c.gcp-upstream.internal';"
2026-08-07 15:21:08,464 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 15:21:08,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 15:21:08,710 [I] DB_PATCHES have already been applied
I20260807 15:21:08.716557 16331 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-admin:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskB0Q6oi/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 15:21:08.716627 16331 mini_ranger.cc:193] Using host: 127.15.242.212
I20260807 15:21:08.722008 16331 mini_ranger.cc:227] Ranger admin URL: http://127.15.242.212:35165
Aug 07, 2026 3:21:09 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 3:21:09 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 3:21:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 3:21:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 3:21:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 3:21:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 3:21:09 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 15:21:10.198554 16331 mini_ranger.cc:160] Time spent starting Ranger: real 9.501s user 0.007s sys 0.007s
Aug 07, 2026 3:21:31 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 3:21:31 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 3:21:31 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 3:21:31 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 3:21:32 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 15:21:32.949908 16331 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/rangerkms_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/rangerkms_127.15.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.242.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.242.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.242.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/HTTP_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.242.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/HTTP_127.15.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 15:21:33 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116093, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 15:21:33.051167 16331 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 15:21:33.062774 16331 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 15:21:34.021548 16331 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 15:21:34.021661 16331 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms
I20260807 15:21:34.021780 16331 mini_ranger_kms.cc:227] Using postgres at 127.15.242.212:47701
2026-08-07 15:21:34,261 [I] DB FLAVOR :POSTGRES
2026-08-07 15:21:34,261 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 15:21:34,261 [I] Checking connection
2026-08-07 15:21:34,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 15:21:34,587 [I] connection success
2026-08-07 15:21:34,588 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 15:21:34,588 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 15:21:34,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 15:21:34,886 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 15:21:34,887 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 15:21:34,887 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 15:21:34,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:47701/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 15:21:35,161 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 15:21:35.650389 16331 mini_ranger_kms.cc:310] Created kms service
I20260807 15:21:35.853332 16331 mini_ranger_kms.cc:326] Created kudu user
I20260807 15:21:35.902451 16331 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 15:21:35 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116093, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:21:36.333266 16331 mini_ranger_kms.cc:384] Added ranger policy
I20260807 15:21:36.333441 16331 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms:/tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 15:21:36.333464 16331 mini_ranger_kms.cc:240] Using host: 127.15.242.212
I20260807 15:21:36.339010 16331 mini_ranger_kms.cc:276] Ranger KMS PID: 1057
I20260807 15:21:36.339191 16331 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.242.212:33417
Aug 07, 2026 3:21:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 3:21:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 3:21:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 3:21:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 3:21:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 3:21:38 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 15:21:38 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786116098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.242.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:21:39.147270 16331 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.096s user 0.012s sys 0.212s
I20260807 15:21:39.147418 16331 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 15:21:39.147537 16331 mini_ranger_kms.cc:401] 127.15.242.212:33417/kms/v1/keys
Aug 07 15:21:39 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.242.212@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
Aug 07 15:21:39 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116098, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.242.212@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
Aug 07 15:21:42 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:21:42.182113 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:44101
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:44101
--ranger_config_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:33417/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:21:42.346035 1141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:21:42.346339 1141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:21:42.346446 1141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:21:42.351022 1141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:21:42.351083 1141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:21:42.351106 1141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:21:42.351125 1141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:21:42.351186 1141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:21:42.356650 1141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.242.212:33417/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:44101
--ranger_config_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:44101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:21:42.357744 1141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:21:42.358800 1141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:21:42.368180 1148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:21:42.368193 1151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:21:42.368193 1147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:21:42.368276 1141 server_base.cc:1034] running on GCE node
I20260807 15:21:42.369108 1141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:21:42.370402 1141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:21:42.371594 1141 hybrid_clock.cc:648] HybridClock initialized: now 1786116102371574 us; error 35 us; skew 500 ppm
Aug 07 15:21:42 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116102, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:21:42.378329 1141 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:21:42.379212 1141 webserver.cc:460] Webserver started at http://127.15.242.254:43261/ using document root <none> and password file <none>
I20260807 15:21:42.379724 1141 fs_manager.cc:359] Metadata directory not provided
I20260807 15:21:42.379777 1141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:21:42.379945 1141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 15:21:42 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116102, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:21:42.438272 1141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5"
format_stamp: "Formatted at 2026-08-07 15:21:42 on dist-test-slave-g170"
server_key: "09039b7adf38463429f2c0a68a005ff3"
server_key_iv: "1b1527df84754520b7887343c8cef22d"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:42.438966 1141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5"
format_stamp: "Formatted at 2026-08-07 15:21:42 on dist-test-slave-g170"
server_key: "09039b7adf38463429f2c0a68a005ff3"
server_key_iv: "1b1527df84754520b7887343c8cef22d"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:42.443604 1141 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 15:21:42.461097 1163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:42.462881 1141 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:21:42.463042 1141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5"
format_stamp: "Formatted at 2026-08-07 15:21:42 on dist-test-slave-g170"
server_key: "09039b7adf38463429f2c0a68a005ff3"
server_key_iv: "1b1527df84754520b7887343c8cef22d"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:42.463207 1141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:21:42.480391 1141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:21:42.483850 1141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:21:42.484113 1141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:21:42.497912 1141 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:44101
I20260807 15:21:42.497991 1252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:44101 every 8 connection(s)
I20260807 15:21:42.499112 1141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:21:42.502451 1253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:21:42.505439 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 1141
I20260807 15:21:42.505587 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:21:42.505937 16331 external_mini_cluster.cc:1428] Setting key 2329b150f5126c1e03d8ea8ca02a75d9
I20260807 15:21:42.510476 1253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5: Bootstrap starting.
I20260807 15:21:42.513924 1253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5: Neither blocks nor log segments found. Creating new log.
I20260807 15:21:42.515481 1253 log.cc:824] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5: Log is configured to *not* fsync() on all Append() calls
Aug 07 15:21:42 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:21:42.518422 1253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5: No bootstrap required, opened a new log
I20260807 15:21:42.523548 1261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:42.507611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47332 (local address 127.15.242.254:44101)
0807 15:21:42.508110 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:42.508132 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:42.508181 (+ 49us) server_negotiation.cc:407] Connection header received
0807 15:21:42.509220 (+ 1039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:42.509246 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:42.509686 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:42.510086 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:21:42.511003 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:42.512970 (+ 1967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:42.513946 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:42.514931 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:42.515137 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:42.518425 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:21:42.518431 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:21:42.518445 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:21:42.518496 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:21:42.520214 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:42.520869 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:42.520875 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:42.520880 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:42.521002 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:42.521402 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:42.521405 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:42.521406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:42.521863 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:21:42.522007 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:42.522428 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 15:21:42.522782 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":113,"threads_started":1}
I20260807 15:21:42.523721 1253 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44101 } }
I20260807 15:21:42.524037 1253 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:21:42.524139 1253 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e57dcb3e6c4bc9ba6a758f54e702e5, State: Initialized, Role: FOLLOWER
I20260807 15:21:42.524608 1253 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44101 } }
I20260807 15:21:42.524858 1253 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:21:42.524936 1253 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:21:42.525043 1253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:21:42.526391 1253 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44101 } }
I20260807 15:21:42.526791 1253 leader_election.cc:302] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9e57dcb3e6c4bc9ba6a758f54e702e5; no voters:
I20260807 15:21:42.527136 1253 leader_election.cc:288] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:21:42.527297 1264 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:21:42.527783 1264 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [term 1 LEADER]: Becoming Leader. State: Replica: b9e57dcb3e6c4bc9ba6a758f54e702e5, State: Running, Role: LEADER
I20260807 15:21:42.528196 1264 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44101 } }
I20260807 15:21:42.528582 1253 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:21:42.529524 1267 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9e57dcb3e6c4bc9ba6a758f54e702e5. Latest consensus state: current_term: 1 leader_uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44101 } } }
I20260807 15:21:42.529762 1267 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [sys.catalog]: This master's current role is: LEADER
I20260807 15:21:42.529913 1266 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e57dcb3e6c4bc9ba6a758f54e702e5" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 44101 } } }
I20260807 15:21:42.530057 1266 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5 [sys.catalog]: This master's current role is: LEADER
I20260807 15:21:42.530498 1276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:21:42.534163 1276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:21:42.534780 1253 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 15:21:42.546017 1276 catalog_manager.cc:1347] Generated new cluster ID: f3d12a76cd0f40589cf0180f2791729e
I20260807 15:21:42.546115 1276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:21:42.555706 1276 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:21:42.557266 1276 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:21:42.567085 1276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5: Generated new TSK 0
I20260807 15:21:42.568320 1276 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:21:43.413056 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:33417/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44101
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:21:43.601665 1330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:21:43.602028 1330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:21:43.602095 1330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:21:43.608103 1330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:21:43.608196 1330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:21:43.608300 1330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:21:43.614811 1330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.242.212:33417/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:21:43.616321 1330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:21:43.617589 1330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:21:43.630429 1343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:21:43.630429 1341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:21:43.630932 1346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:21:43.631309 1330 server_base.cc:1034] running on GCE node
I20260807 15:21:43.631788 1330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:21:43.632558 1330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:21:43.633776 1330 hybrid_clock.cc:648] HybridClock initialized: now 1786116103633732 us; error 58 us; skew 500 ppm
Aug 07 15:21:43 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116103, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:21:43.637526 1330 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:21:43.638644 1330 webserver.cc:460] Webserver started at http://127.15.242.193:32943/ using document root <none> and password file <none>
I20260807 15:21:43.639256 1330 fs_manager.cc:359] Metadata directory not provided
I20260807 15:21:43.639355 1330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:21:43.639595 1330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 15:21:43 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116103, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:21:43.659601 1330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "7bd795ecede84f23a2e50eafec8d625f"
format_stamp: "Formatted at 2026-08-07 15:21:43 on dist-test-slave-g170"
server_key: "dab62b39f45dbf81415b05630708fee2"
server_key_iv: "00947261ab58497fc23fd533ca73275b"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:43.660523 1330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "7bd795ecede84f23a2e50eafec8d625f"
format_stamp: "Formatted at 2026-08-07 15:21:43 on dist-test-slave-g170"
server_key: "dab62b39f45dbf81415b05630708fee2"
server_key_iv: "00947261ab58497fc23fd533ca73275b"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:43.666430 1330 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260807 15:21:43.685977 1353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:43.696362 1330 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.001s
I20260807 15:21:43.696646 1330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "7bd795ecede84f23a2e50eafec8d625f"
format_stamp: "Formatted at 2026-08-07 15:21:43 on dist-test-slave-g170"
server_key: "dab62b39f45dbf81415b05630708fee2"
server_key_iv: "00947261ab58497fc23fd533ca73275b"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:43.696929 1330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:21:43.761423 1330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:21:43.765698 1330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:21:43.765915 1330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:21:43.766937 1330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:21:43.768522 1330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:21:43.768630 1330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:43.768692 1330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:21:43.768723 1330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:43.790035 1330 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:38217
I20260807 15:21:43.791425 1330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:21:43.793074 1520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:38217 every 8 connection(s)
I20260807 15:21:43.796809 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 1330
I20260807 15:21:43.796952 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:21:43.797276 16331 external_mini_cluster.cc:1428] Setting key f09c0113de7795ab6b712f492d22d4c8
Aug 07 15:21:43 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116103, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:21:43.813352 1527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:43.794286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:55999 (local address 127.15.242.254:44101)
0807 15:21:43.794631 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:43.794636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:43.795505 (+ 869us) server_negotiation.cc:407] Connection header received
0807 15:21:43.797198 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:43.797208 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:43.797300 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:43.797397 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:21:43.800127 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:43.801241 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:43.803531 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:43.803906 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:43.804023 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:43.808053 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:21:43.808059 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:21:43.808065 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:21:43.808100 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:21:43.810336 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:43.811047 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:43.811054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:43.811058 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:43.811173 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:43.811693 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:43.811699 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:43.811702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:43.811990 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:21:43.812080 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:43.812975 (+ 895us) server_negotiation.cc:299] Negotiation successful
0807 15:21:43.813127 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:21:43.815595 1528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:43.794456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44101 (local address 127.15.242.193:55999)
0807 15:21:43.795336 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:43.795393 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:43.796822 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:21:43.798156 (+ 1334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:21:43.798181 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:21:43.798801 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:21:43.799924 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:43.799949 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:43.801443 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:43.801447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:43.803362 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:43.803375 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:43.804406 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:43.804410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:43.804676 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:43.805569 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:21:43.805591 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:21:43.807784 (+ 2193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:21:43.810492 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:21:43.810501 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:21:43.810522 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:21:43.810913 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:21:43.811311 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:21:43.811316 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:21:43.811321 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:21:43.811559 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:21:43.812196 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:21:43.812207 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:21:43.812590 (+ 383us) client_negotiation.cc:769] Sending connection context
0807 15:21:43.813897 (+ 1307us) client_negotiation.cc:240] Negotiation successful
0807 15:21:43.814291 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":171,"threads_started":1}
I20260807 15:21:43.817123 1521 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44101
I20260807 15:21:43.817414 1521 heartbeater.cc:464] Registering TS with master...
I20260807 15:21:43.817988 1521 heartbeater.cc:511] Master 127.15.242.254:44101 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:21:43.819912 1190 ts_manager.cc:194] Registered new tserver with Master: 7bd795ecede84f23a2e50eafec8d625f (127.15.242.193:38217)
I20260807 15:21:43.821372 1190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:55999
Aug 07 15:21:43 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786116103, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:21:43.845212 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:33417/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44101
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:21:44.016713 1531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:21:44.017138 1531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:21:44.017234 1531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:21:44.021727 1531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:21:44.021833 1531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:21:44.021945 1531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:21:44.028692 1531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.242.212:33417/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:21:44.030128 1531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:21:44.031397 1531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:21:44.044158 1544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:21:44.044265 1547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:21:44.044831 1531 server_base.cc:1034] running on GCE node
W20260807 15:21:44.044456 1549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:21:44.045431 1531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:21:44.046213 1531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:21:44.047425 1531 hybrid_clock.cc:648] HybridClock initialized: now 1786116104047386 us; error 52 us; skew 500 ppm
Aug 07 15:21:44 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116104, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:21:44.051458 1531 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:21:44.052599 1531 webserver.cc:460] Webserver started at http://127.15.242.194:40875/ using document root <none> and password file <none>
I20260807 15:21:44.053406 1531 fs_manager.cc:359] Metadata directory not provided
I20260807 15:21:44.053505 1531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:21:44.053761 1531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 15:21:44 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116104, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:21:44.071775 1531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "8b219b95510d44c888699a4244a92470"
format_stamp: "Formatted at 2026-08-07 15:21:44 on dist-test-slave-g170"
server_key: "557078d3878273a7a3a8945e17f944f1"
server_key_iv: "fcf72182e4c0356d5bf6d86401d45bfb"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:44.072634 1531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "8b219b95510d44c888699a4244a92470"
format_stamp: "Formatted at 2026-08-07 15:21:44 on dist-test-slave-g170"
server_key: "557078d3878273a7a3a8945e17f944f1"
server_key_iv: "fcf72182e4c0356d5bf6d86401d45bfb"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:44.091794 1531 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.004s sys 0.000s
I20260807 15:21:44.122874 1558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:44.124572 1531 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:21:44.124732 1531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "8b219b95510d44c888699a4244a92470"
format_stamp: "Formatted at 2026-08-07 15:21:44 on dist-test-slave-g170"
server_key: "557078d3878273a7a3a8945e17f944f1"
server_key_iv: "fcf72182e4c0356d5bf6d86401d45bfb"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:44.124907 1531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:21:44.146494 1531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:21:44.150959 1531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:21:44.151183 1531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:21:44.152033 1531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:21:44.153422 1531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:21:44.153496 1531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:44.153563 1531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:21:44.153596 1531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:44.177145 1531 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:45401
I20260807 15:21:44.177179 1727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:45401 every 8 connection(s)
I20260807 15:21:44.178130 1531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:21:44.186378 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 1531
I20260807 15:21:44.186556 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:21:44.186990 16331 external_mini_cluster.cc:1428] Setting key 7f5a52f9ada8598d8982be743dd36edb
Aug 07 15:21:44 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116104, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:21:44.203011 1527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.180399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:60037 (local address 127.15.242.254:44101)
0807 15:21:44.180537 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.180542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.185493 (+ 4951us) server_negotiation.cc:407] Connection header received
0807 15:21:44.187290 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.187294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.187360 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.187468 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:21:44.190121 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.191015 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.193170 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.193636 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.193754 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.198370 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:21:44.198380 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:21:44.198383 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:21:44.198416 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:21:44.200361 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:44.201079 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:44.201083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:44.201085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:44.201180 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:44.201583 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:44.201587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:44.201589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:44.201839 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:21:44.201924 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.202652 (+ 728us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.202806 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:21:44.205240 1731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.180970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44101 (local address 127.15.242.194:60037)
0807 15:21:44.185228 (+ 4258us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.185329 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:44.186985 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:21:44.188043 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:21:44.188054 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:21:44.188533 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:21:44.189937 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.189960 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.191228 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.191232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.192935 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.192948 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.194716 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.194720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.194984 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.195894 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:21:44.195918 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:21:44.198133 (+ 2215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:21:44.200502 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:21:44.200509 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:21:44.200528 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:21:44.200953 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:21:44.201289 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:21:44.201292 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:21:44.201294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:21:44.201469 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:21:44.201994 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:21:44.202002 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:21:44.202337 (+ 335us) client_negotiation.cc:769] Sending connection context
0807 15:21:44.203583 (+ 1246us) client_negotiation.cc:240] Negotiation successful
0807 15:21:44.203972 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3845,"thread_start_us":190,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:21:44.206884 1728 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44101
I20260807 15:21:44.207291 1728 heartbeater.cc:464] Registering TS with master...
I20260807 15:21:44.208030 1728 heartbeater.cc:511] Master 127.15.242.254:44101 requested a full tablet report, sending...
I20260807 15:21:44.213191 1190 ts_manager.cc:194] Registered new tserver with Master: 8b219b95510d44c888699a4244a92470 (127.15.242.194:45401)
I20260807 15:21:44.213867 1190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:60037
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:21:44.232365 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:33417/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44101
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:21:44.436087 1735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:21:44.436532 1735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:21:44.436638 1735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:21:44.443240 1735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:21:44.443394 1735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:21:44.443512 1735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
Aug 07 15:21:44 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116103, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:21:44.451972 1735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.242.212:33417/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:44101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:21:44.453850 1735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:21:44.456259 1735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:21:44.473780 1749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:21:44.474161 1743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:21:44.474388 1746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:21:44.478689 1735 server_base.cc:1034] running on GCE node
I20260807 15:21:44.479502 1735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:21:44.480497 1735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:21:44.481830 1735 hybrid_clock.cc:648] HybridClock initialized: now 1786116104481782 us; error 63 us; skew 500 ppm
Aug 07 15:21:44 dist-test-slave-g170 krb5kdc[459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116104, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:21:44.486311 1735 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:21:44.487712 1735 webserver.cc:460] Webserver started at http://127.15.242.195:33911/ using document root <none> and password file <none>
I20260807 15:21:44.488557 1735 fs_manager.cc:359] Metadata directory not provided
I20260807 15:21:44.488721 1735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:21:44.489040 1735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 15:21:44 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116104, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:21:44.521852 1735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "a2173cbcdf344bc6897c7424db18f9ff"
format_stamp: "Formatted at 2026-08-07 15:21:44 on dist-test-slave-g170"
server_key: "dc56952961719b75cbd83ec5c06f2c61"
server_key_iv: "a7c899f5da3e004a6ca0adb6ffa69f72"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:44.522653 1735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "a2173cbcdf344bc6897c7424db18f9ff"
format_stamp: "Formatted at 2026-08-07 15:21:44 on dist-test-slave-g170"
server_key: "dc56952961719b75cbd83ec5c06f2c61"
server_key_iv: "a7c899f5da3e004a6ca0adb6ffa69f72"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:44.527927 1735 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 15:21:44.547735 1762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:44.549474 1735 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:21:44.549631 1735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "a2173cbcdf344bc6897c7424db18f9ff"
format_stamp: "Formatted at 2026-08-07 15:21:44 on dist-test-slave-g170"
server_key: "dc56952961719b75cbd83ec5c06f2c61"
server_key_iv: "a7c899f5da3e004a6ca0adb6ffa69f72"
server_key_version: "kuduclusterkey@0"
I20260807 15:21:44.549791 1735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:21:44.568181 1735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:21:44.572242 1735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:21:44.572436 1735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:21:44.573285 1735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:21:44.574579 1735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:21:44.574646 1735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:44.574703 1735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:21:44.574739 1735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:21:44.594430 1735 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:42879
I20260807 15:21:44.594566 1924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:42879 every 8 connection(s)
I20260807 15:21:44.595606 1735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:21:44.597788 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 1735
I20260807 15:21:44.597921 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:21:44.598254 16331 external_mini_cluster.cc:1428] Setting key f67cbf034b5bb15fe1f214efea45064b
Aug 07 15:21:44 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116104, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:21:44.613006 1527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.600431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:33951 (local address 127.15.242.254:44101)
0807 15:21:44.600577 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.600582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.601188 (+ 606us) server_negotiation.cc:407] Connection header received
0807 15:21:44.602100 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.602104 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.602156 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.602236 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:21:44.603699 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.604317 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.605681 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.605914 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.606032 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.608821 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:21:44.608825 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:21:44.608830 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:21:44.608860 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:21:44.610340 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:44.610874 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:44.610881 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:44.610883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:44.610978 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:44.611578 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:44.611581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:44.611583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:44.611818 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:21:44.611900 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.612681 (+ 781us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.612837 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 15:21:44.614157 1929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.598665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:44101 (local address 127.15.242.195:33951)
0807 15:21:44.601038 (+ 2373us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.601086 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:44.601902 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:21:44.602415 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:21:44.602423 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:21:44.602832 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:21:44.603548 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.603567 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.604441 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.604445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.605543 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.605554 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.606071 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.606075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.606303 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.607022 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:21:44.607039 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:21:44.608625 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:21:44.610465 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:21:44.610472 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:21:44.610488 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:21:44.610766 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:21:44.611086 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:21:44.611089 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:21:44.611091 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:21:44.611462 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:21:44.611993 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:21:44.612000 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:21:44.612339 (+ 339us) client_negotiation.cc:769] Sending connection context
0807 15:21:44.612629 (+ 290us) client_negotiation.cc:240] Negotiation successful
0807 15:21:44.612981 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2155,"thread_start_us":267,"threads_started":1}
I20260807 15:21:44.615471 1926 heartbeater.cc:347] Connected to a master server at 127.15.242.254:44101
I20260807 15:21:44.615753 1926 heartbeater.cc:464] Registering TS with master...
I20260807 15:21:44.616276 1926 heartbeater.cc:511] Master 127.15.242.254:44101 requested a full tablet report, sending...
I20260807 15:21:44.617360 1190 ts_manager.cc:194] Registered new tserver with Master: a2173cbcdf344bc6897c7424db18f9ff (127.15.242.195:42879)
I20260807 15:21:44.617944 1190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:33951
I20260807 15:21:44.624548 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:21:44.640802 1527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.629470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47338 (local address 127.15.242.254:44101)
0807 15:21:44.629633 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.629638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.630320 (+ 682us) server_negotiation.cc:407] Connection header received
0807 15:21:44.630520 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.630525 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.630595 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.630651 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:21:44.631788 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.632596 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.633896 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.634227 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.634310 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.636418 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:21:44.636422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:21:44.636425 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:21:44.636456 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:21:44.638356 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:44.638925 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:44.638929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:44.638931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:44.639020 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:21:44.639355 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:21:44.639359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:21:44.639360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:21:44.639619 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:21:44.639752 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.640425 (+ 673us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.640570 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 15:21:44.645598 1190 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:21:44.651211 1190 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:21:44.684656 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.671336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:45401 (local address 127.0.0.1:57880)
0807 15:21:44.675419 (+ 4083us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.675431 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:44.675504 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:21:44.676290 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:21:44.676297 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:21:44.676323 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:21:44.676471 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.676478 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.678865 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.678868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.680289 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.680301 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.684012 (+ 3711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.684016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.684203 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.684251 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 15:21:44.684367 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 15:21:44.684501 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4022,"thread_start_us":78,"threads_started":1}
I20260807 15:21:44.690315 1946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.672133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57880 (local address 127.15.242.194:45401)
0807 15:21:44.674716 (+ 2583us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.674731 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.675595 (+ 864us) server_negotiation.cc:407] Connection header received
0807 15:21:44.675716 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.675722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.675947 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.676105 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:21:44.676609 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.678723 (+ 2114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.681355 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.682442 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.682569 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.682811 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.689994 (+ 7183us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.690120 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2472,"thread_start_us":137,"threads_started":1}
I20260807 15:21:44.694028 1607 tablet_service.cc:1467] Processing CreateTablet for tablet f0b4841c198a402597847207bae6cd7c (DEFAULT_TABLE table=test-table [id=2a382aec7ce34f26879a2f310e212c91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:21:44.695401 1607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0b4841c198a402597847207bae6cd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:21:44.698092 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.673361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41266 (local address 127.15.242.195:42879)
0807 15:21:44.674520 (+ 1159us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.674533 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.683839 (+ 9306us) server_negotiation.cc:407] Connection header received
0807 15:21:44.685071 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.685077 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.685999 (+ 922us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.686178 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:21:44.688495 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.689842 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.693782 (+ 3940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.694692 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.694798 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.694927 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.697761 (+ 2834us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.697894 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1044,"thread_start_us":129,"threads_started":1}
I20260807 15:21:44.699596 1941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.672941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42879 (local address 127.0.0.1:41266)
0807 15:21:44.683700 (+ 10759us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.683714 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:44.683913 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:21:44.686362 (+ 2449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:21:44.686365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:21:44.686384 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:21:44.686519 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.686525 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.692165 (+ 5640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.692169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.693505 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.693517 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.695038 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.695041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.695194 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.695220 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 15:21:44.699329 (+ 4109us) client_negotiation.cc:240] Negotiation successful
0807 15:21:44.699426 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10681,"thread_start_us":89,"threads_started":1}
I20260807 15:21:44.703083 1827 tablet_service.cc:1467] Processing CreateTablet for tablet f0b4841c198a402597847207bae6cd7c (DEFAULT_TABLE table=test-table [id=2a382aec7ce34f26879a2f310e212c91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:21:44.704409 1827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0b4841c198a402597847207bae6cd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:21:44.717345 1943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.671251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38217 (local address 127.0.0.1:57430)
0807 15:21:44.675009 (+ 3758us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.675063 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:44.675196 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:21:44.686676 (+ 11480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:21:44.686679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:21:44.686696 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:21:44.686856 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.686862 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.695361 (+ 8499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.695364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.696455 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.696466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.716239 (+ 19773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.716244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.716454 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.716492 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 15:21:44.716561 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 15:21:44.716700 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3575,"thread_start_us":104,"threads_started":1}
I20260807 15:21:44.717286 1949 tablet_bootstrap.cc:492] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470: Bootstrap starting.
I20260807 15:21:44.718307 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.671372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57430 (local address 127.15.242.193:38217)
0807 15:21:44.683037 (+ 11665us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.683044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.683070 (+ 26us) server_negotiation.cc:407] Connection header received
0807 15:21:44.683150 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.683155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.683374 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.687022 (+ 3648us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:21:44.687195 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.688335 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.696647 (+ 8312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.697582 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.717721 (+ 20139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.717919 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.717983 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.718124 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11543,"thread_start_us":125,"threads_started":1}
I20260807 15:21:44.720034 1951 tablet_bootstrap.cc:492] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Bootstrap starting.
I20260807 15:21:44.721853 1427 tablet_service.cc:1467] Processing CreateTablet for tablet f0b4841c198a402597847207bae6cd7c (DEFAULT_TABLE table=test-table [id=2a382aec7ce34f26879a2f310e212c91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:21:44.722730 1949 tablet_bootstrap.cc:654] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470: Neither blocks nor log segments found. Creating new log.
I20260807 15:21:44.723642 1427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0b4841c198a402597847207bae6cd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:21:44.724941 1949 log.cc:824] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470: Log is configured to *not* fsync() on all Append() calls
I20260807 15:21:44.726948 1951 tablet_bootstrap.cc:654] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Neither blocks nor log segments found. Creating new log.
I20260807 15:21:44.727623 1949 tablet_bootstrap.cc:492] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470: No bootstrap required, opened a new log
I20260807 15:21:44.727890 1949 ts_tablet_manager.cc:1397] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260807 15:21:44.728472 1951 log.cc:824] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Log is configured to *not* fsync() on all Append() calls
I20260807 15:21:44.734282 1949 raft_consensus.cc:348] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.734721 1949 raft_consensus.cc:374] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:21:44.734827 1949 raft_consensus.cc:729] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b219b95510d44c888699a4244a92470, State: Initialized, Role: FOLLOWER
I20260807 15:21:44.735417 1949 consensus_queue.cc:260] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.736865 1949 ts_tablet_manager.cc:1428] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260807 15:21:44.737315 1728 heartbeater.cc:503] Master 127.15.242.254:44101 was elected leader, sending a full tablet report...
I20260807 15:21:44.738397 1951 tablet_bootstrap.cc:492] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: No bootstrap required, opened a new log
I20260807 15:21:44.739166 1957 tablet_bootstrap.cc:492] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f: Bootstrap starting.
I20260807 15:21:44.743150 1957 tablet_bootstrap.cc:654] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f: Neither blocks nor log segments found. Creating new log.
I20260807 15:21:44.738624 1951 ts_tablet_manager.cc:1397] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.002s
I20260807 15:21:44.744398 1957 log.cc:824] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f: Log is configured to *not* fsync() on all Append() calls
I20260807 15:21:44.747105 1957 tablet_bootstrap.cc:492] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f: No bootstrap required, opened a new log
I20260807 15:21:44.747354 1957 ts_tablet_manager.cc:1397] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260807 15:21:44.750243 1951 raft_consensus.cc:348] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.750590 1951 raft_consensus.cc:374] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:21:44.750644 1951 raft_consensus.cc:729] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2173cbcdf344bc6897c7424db18f9ff, State: Initialized, Role: FOLLOWER
I20260807 15:21:44.751212 1951 consensus_queue.cc:260] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.752485 1951 ts_tablet_manager.cc:1428] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 15:21:44.753041 1926 heartbeater.cc:503] Master 127.15.242.254:44101 was elected leader, sending a full tablet report...
I20260807 15:21:44.753733 1957 raft_consensus.cc:348] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.754096 1957 raft_consensus.cc:374] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:21:44.754201 1957 raft_consensus.cc:729] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd795ecede84f23a2e50eafec8d625f, State: Initialized, Role: FOLLOWER
I20260807 15:21:44.754748 1957 consensus_queue.cc:260] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.756165 1957 ts_tablet_manager.cc:1428] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f: Time spent starting tablet: real 0.009s user 0.006s sys 0.003s
I20260807 15:21:44.756371 1521 heartbeater.cc:503] Master 127.15.242.254:44101 was elected leader, sending a full tablet report...
I20260807 15:21:44.776525 1958 raft_consensus.cc:482] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:21:44.776919 1958 raft_consensus.cc:504] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.778357 1958 leader_election.cc:288] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bd795ecede84f23a2e50eafec8d625f (127.15.242.193:38217), a2173cbcdf344bc6897c7424db18f9ff (127.15.242.195:42879)
I20260807 15:21:44.794649 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.779724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:51959 (local address 127.15.242.193:38217)
0807 15:21:44.779981 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.779986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.780425 (+ 439us) server_negotiation.cc:407] Connection header received
0807 15:21:44.780631 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.780635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.780681 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.780728 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:21:44.781399 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.782276 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.792895 (+ 10619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.793625 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.793744 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.793810 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.794398 (+ 588us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.794493 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260807 15:21:44.795315 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.778736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38217 (local address 127.15.242.194:51959)
0807 15:21:44.780297 (+ 1561us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.780313 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:44.780512 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:21:44.780908 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:21:44.780911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:21:44.781005 (+ 94us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:21:44.781262 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.781269 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.782553 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.782557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.785328 (+ 2771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.785349 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.793988 (+ 8639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.793992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.794189 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.794225 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 15:21:44.794840 (+ 615us) client_negotiation.cc:240] Negotiation successful
0807 15:21:44.794934 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1491,"thread_start_us":215,"threads_started":1}
W20260807 15:21:44.795868 1525 tablet.cc:2369] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:21:44.796733 1430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0b4841c198a402597847207bae6cd7c" candidate_uuid: "8b219b95510d44c888699a4244a92470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd795ecede84f23a2e50eafec8d625f" is_pre_election: true
I20260807 15:21:44.797066 1430 raft_consensus.cc:2454] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b219b95510d44c888699a4244a92470 in term 0.
I20260807 15:21:44.797675 1561 leader_election.cc:302] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bd795ecede84f23a2e50eafec8d625f, 8b219b95510d44c888699a4244a92470; no voters:
I20260807 15:21:44.797999 1958 raft_consensus.cc:2781] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:21:44.798080 1958 raft_consensus.cc:482] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:21:44.798133 1958 raft_consensus.cc:3037] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:21:44.799844 1958 raft_consensus.cc:504] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.800232 1958 leader_election.cc:288] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [CANDIDATE]: Term 1 election: Requested vote from peers 7bd795ecede84f23a2e50eafec8d625f (127.15.242.193:38217), a2173cbcdf344bc6897c7424db18f9ff (127.15.242.195:42879)
I20260807 15:21:44.800683 1430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0b4841c198a402597847207bae6cd7c" candidate_uuid: "8b219b95510d44c888699a4244a92470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd795ecede84f23a2e50eafec8d625f"
I20260807 15:21:44.800824 1430 raft_consensus.cc:3037] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:21:44.802110 1430 raft_consensus.cc:2454] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b219b95510d44c888699a4244a92470 in term 1.
I20260807 15:21:44.802484 1561 leader_election.cc:302] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bd795ecede84f23a2e50eafec8d625f, 8b219b95510d44c888699a4244a92470; no voters:
I20260807 15:21:44.802678 1958 raft_consensus.cc:2781] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:21:44.802927 1958 raft_consensus.cc:686] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 1 LEADER]: Becoming Leader. State: Replica: 8b219b95510d44c888699a4244a92470, State: Running, Role: LEADER
I20260807 15:21:44.803318 1958 consensus_queue.cc:237] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } }
I20260807 15:21:44.806910 1189 catalog_manager.cc:5495] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b219b95510d44c888699a4244a92470 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "8b219b95510d44c888699a4244a92470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b219b95510d44c888699a4244a92470" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 } health_report { overall_health: UNKNOWN } } }
I20260807 15:21:44.820312 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.779848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:48915 (local address 127.15.242.195:42879)
0807 15:21:44.780067 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.780071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.783279 (+ 3208us) server_negotiation.cc:407] Connection header received
0807 15:21:44.785829 (+ 2550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.785834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.785948 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.786030 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:21:44.786933 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.787856 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.818686 (+ 30830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.819361 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.819477 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.819543 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.820037 (+ 494us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.820127 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260807 15:21:44.820885 1964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.779237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42879 (local address 127.15.242.194:48915)
0807 15:21:44.783078 (+ 3841us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.783103 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:44.785592 (+ 2489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:21:44.786296 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:21:44.786299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:21:44.786326 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:21:44.786706 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.786714 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.788126 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.788129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.818451 (+ 30322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:21:44.818470 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.819726 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.819730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:21:44.819874 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.819900 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 15:21:44.820561 (+ 661us) client_negotiation.cc:240] Negotiation successful
0807 15:21:44.820655 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3726,"thread_start_us":123,"threads_started":1}
I20260807 15:21:44.821861 1851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0b4841c198a402597847207bae6cd7c" candidate_uuid: "8b219b95510d44c888699a4244a92470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2173cbcdf344bc6897c7424db18f9ff"
I20260807 15:21:44.821928 1855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0b4841c198a402597847207bae6cd7c" candidate_uuid: "8b219b95510d44c888699a4244a92470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2173cbcdf344bc6897c7424db18f9ff" is_pre_election: true
I20260807 15:21:44.822149 1851 raft_consensus.cc:3037] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:21:44.824023 1851 raft_consensus.cc:2454] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b219b95510d44c888699a4244a92470 in term 1.
I20260807 15:21:44.837693 1946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.832139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57884 (local address 127.15.242.194:45401)
0807 15:21:44.832263 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 15:21:44.832269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:21:44.832568 (+ 299us) server_negotiation.cc:407] Connection header received
0807 15:21:44.832660 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:21:44.832663 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:21:44.832732 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:21:44.832861 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:21:44.833264 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.834011 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.835285 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:21:44.835603 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:21:44.835716 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:21:44.836157 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:21:44.836836 (+ 679us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:21:44.836958 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 15:21:44.837447 (+ 489us) server_negotiation.cc:299] Negotiation successful
0807 15:21:44.837529 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 15:21:44.845716 1851 raft_consensus.cc:1261] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [term 1 FOLLOWER]: Refusing update from remote peer 8b219b95510d44c888699a4244a92470: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:21:44.846493 1968 consensus_queue.cc:1035] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2173cbcdf344bc6897c7424db18f9ff" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 15:21:44.847409 1928 tablet.cc:2369] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:21:44.854969 1430 raft_consensus.cc:1261] T f0b4841c198a402597847207bae6cd7c P 7bd795ecede84f23a2e50eafec8d625f [term 1 FOLLOWER]: Refusing update from remote peer 8b219b95510d44c888699a4244a92470: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:21:44.855690 1968 consensus_queue.cc:1035] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd795ecede84f23a2e50eafec8d625f" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:21:44.869138 1972 mvcc.cc:205] Tried to move back new op lower bound from 7315931565438230528 to 7315931565278355456. Current Snapshot: MvccSnapshot[applied={T|T < 7315931565438230528}]
I20260807 15:21:44.869324 1975 mvcc.cc:205] Tried to move back new op lower bound from 7315931565438230528 to 7315931565278355456. Current Snapshot: MvccSnapshot[applied={T|T < 7315931565438230528}]
I20260807 15:21:44.880929 1190 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:21:44.881124 1190 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:21:44.884402 1190 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b9e57dcb3e6c4bc9ba6a758f54e702e5: Sending DeleteTablet for 3 replicas of tablet f0b4841c198a402597847207bae6cd7c
I20260807 15:21:44.885476 1427 tablet_service.cc:1514] Processing DeleteTablet for tablet f0b4841c198a402597847207bae6cd7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:21:44 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:57430
I20260807 15:21:44.885514 1827 tablet_service.cc:1514] Processing DeleteTablet for tablet f0b4841c198a402597847207bae6cd7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:21:44 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:41266
I20260807 15:21:44.886399 1607 tablet_service.cc:1514] Processing DeleteTablet for tablet f0b4841c198a402597847207bae6cd7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:21:44 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:57880
I20260807 15:21:44.889741 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 1330
I20260807 15:21:44.894001 1973 mvcc.cc:205] Tried to move back new op lower bound from 7315931565438230528 to 7315931565278355456. Current Snapshot: MvccSnapshot[applied={T|T < 7315931565438230528}]
I20260807 15:21:44.894387 1992 tablet_replica.cc:330] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: stopping tablet replica
I20260807 15:21:44.894471 1994 tablet_replica.cc:330] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470: stopping tablet replica
I20260807 15:21:44.894778 1992 raft_consensus.cc:2229] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:21:44.895088 1992 raft_consensus.cc:2258] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:21:44.896749 1994 raft_consensus.cc:2229] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:21:44.904915 1994 raft_consensus.cc:2258] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:21:44.906752 1994 ts_tablet_manager.cc:1905] T f0b4841c198a402597847207bae6cd7c P 8b219b95510d44c888699a4244a92470: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:21:44.908149 1992 ts_tablet_manager.cc:1905] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:21:44.911737 1992 ts_tablet_manager.cc:1918] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:21:44.911855 1992 log.cc:1196] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/f0b4841c198a402597847207bae6cd7c
I20260807 15:21:44.912851 1992 ts_tablet_manager.cc:1939] T f0b4841c198a402597847207bae6cd7c P a2173cbcdf344bc6897c7424db18f9ff: Deleting consensus metadata
W20260807 15:21:44.913579 1167 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:38217 (error 108)
I20260807 15:21:44.914525 1167 catalog_manager.cc:4841] TS a2173cbcdf344bc6897c7424db18f9ff (127.15.242.195:42879): tablet f0b4841c198a402597847207bae6cd7c (table test-table [id=2a382aec7ce34f26879a2f310e212c91]) successfully deleted
I20260807 15:21:44.917397 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 1531
I20260807 15:21:44.949301 1943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:21:44.948837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38217 (local address 127.0.0.1:57446)
0807 15:21:44.949091 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.949191 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:38217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
W20260807 15:21:44.949566 1167 catalog_manager.cc:4584] TS 7bd795ecede84f23a2e50eafec8d625f (127.15.242.193:38217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f0b4841c198a402597847207bae6cd7c: Network error: Client connection negotiation failed: client connection to 127.15.242.193:38217: connect: Connection refused (error 111)
Aug 07 15:21:44 dist-test-slave-g170 krb5kdc[459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116103, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
W20260807 15:21:44.957527 1943 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:21:44.957160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:45401 (local address 127.0.0.1:57886)
0807 15:21:44.957296 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 15:21:44.957315 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:21:44.957398 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.194:45401: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 15:21:44.957775 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 1735
I20260807 15:21:44.990147 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 1141
I20260807 15:21:45.005993 16331 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 15:21:45.353494 16331 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 15:21:45.353675 16331 mini_ranger.cc:66] Stopping Ranger...
I20260807 15:21:45.709987 16331 mini_ranger.cc:68] Stopped Ranger
2026-08-07 15:21:45.710 UTC [504] LOG: received smart shutdown request
2026-08-07 15:21:45.714 UTC [504] LOG: background worker "logical replication launcher" (PID 517) exited with exit code 1
2026-08-07 15:21:45.714 UTC [512] LOG: shutting down
2026-08-07 15:21:45.877 UTC [504] LOG: database system is shut down
2026-08-07T15:21:45Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50675 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:21:46 dist-test-slave-g170 krb5kdc[2008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:21:46 dist-test-slave-g170 krb5kdc[2008](info): set up 2 sockets
Aug 07 15:21:46 dist-test-slave-g170 krb5kdc[2008](info): commencing operation
krb5kdc: starting...
W20260807 15:21:47.323030 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:21:47 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:21:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:21:47Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/rangeradmin_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/rangeradmin_127.15.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/rangerlookup_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/rangerlookup_127.15.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/HTTP_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/HTTP_127.15.242.212@KRBTEST.COM.keytab.
I20260807 15:21:47.533876 16331 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskB0Q6oi/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/postgres -l logfile start
2026-08-07 15:21:50.205 UTC [2047] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 15:21:50.205 UTC [2047] LOG: listening on IPv4 address "127.15.242.212", port 43663
2026-08-07 15:21:50.208 UTC [2047] LOG: listening on Unix socket "/tmp/.s.PGSQL.43663"
2026-08-07 15:21:50.232 UTC [2053] LOG: database system was shut down at 2026-08-07 15:21:48 UTC
2026-08-07 15:21:50.235 UTC [2047] LOG: database system is ready to accept connections
I20260807 15:21:51.436821 16331 mini_postgres.cc:96] Postgres bound to 43663
2026-08-07 15:21:51.444 UTC [2066] FATAL: database "slave" does not exist
127.15.242.212:43663 - accepting connections
I20260807 15:21:51.445551 16331 mini_ranger.cc:161] Starting Ranger...
I20260807 15:21:51.462530 16331 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 15:21:51.974110 16331 mini_ranger.cc:87] Created ranger Postgres database
I20260807 15:21:51.974200 16331 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-admin
2026-08-07 15:21:52,279 [I] DB FLAVOR :POSTGRES
2026-08-07 15:21:52,280 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 15:21:52,280 [I] Checking connection..
2026-08-07 15:21:52,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 15:21:52,559 [I] Checking connection passed.
2026-08-07 15:21:52,559 [I] --------- Verifying version history table ---------
2026-08-07 15:21:52,560 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 15:21:52,844 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 15:21:52,845 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 15:21:53,130 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 15:21:53,131 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 15:21:53,131 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 15:21:53.388 UTC [2162] WARNING: there is no transaction in progress
2026-08-07 15:21:53,399 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 15:21:53,399 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 15:21:53,642 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 15:21:53,643 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 15:21:53,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 15:21:53,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 15:21:54,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-g170.c.gcp-upstream.internal','N') ;"
2026-08-07 15:21:54,425 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 15:21:54,708 [I] Table x_portal_user does not exist in database ranger
2026-08-07 15:21:54,708 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 15:21:54,980 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 15:21:54,981 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 15:21:55,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 15:21:55,517 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 15:21:55,517 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 15:21:56.536 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.553 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.569 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.586 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.601 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.618 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.679 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.686 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.700 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.711 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.720 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.735 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.745 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.752 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.760 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:56.766 UTC [2326] WARNING: there is no transaction in progress
2026-08-07 15:21:57,458 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 15:21:57,458 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 15:21:57,722 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 15:21:57,723 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 15:21:58,025 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 15:21:58,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 15:21:58,312 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 15:21:58,313 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 15:21:58,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 15:21:58,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-g170.c.gcp-upstream.internal';"
2026-08-07 15:21:59,151 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 15:21:59,151 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 15:21:59,411 [I] DB_PATCHES have already been applied
I20260807 15:21:59.417519 16331 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-admin:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskB0Q6oi/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 15:21:59.417585 16331 mini_ranger.cc:193] Using host: 127.15.242.212
I20260807 15:21:59.422288 16331 mini_ranger.cc:227] Ranger admin URL: http://127.15.242.212:41815
Aug 07, 2026 3:21:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 3:21:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 3:21:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 3:21:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 3:21:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 3:22:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 3:22:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 15:22:00.814152 16331 mini_ranger.cc:160] Time spent starting Ranger: real 9.369s user 0.004s sys 0.009s
Aug 07, 2026 3:22:20 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 3:22:20 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 3:22:20 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 3:22:20 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 3:22:22 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 15:22:23.425755 16331 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/rangerkms_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/rangerkms_127.15.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.242.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.242.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.242.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/HTTP_127.15.242.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.242.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/HTTP_127.15.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 15:22:23 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116143, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 15:22:23.540232 16331 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 15:22:23.553390 16331 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 15:22:24.459909 16331 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 15:22:24.460011 16331 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms
I20260807 15:22:24.460036 16331 mini_ranger_kms.cc:227] Using postgres at 127.15.242.212:43663
2026-08-07 15:22:24,661 [I] DB FLAVOR :POSTGRES
2026-08-07 15:22:24,661 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 15:22:24,661 [I] Checking connection
2026-08-07 15:22:24,662 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 15:22:24,974 [I] connection success
2026-08-07 15:22:24,974 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 15:22:24,974 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 15:22:24,975 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 15:22:25,278 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 15:22:25,278 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 15:22:25,278 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 15:22:25,278 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.242.212:43663/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 15:22:25,572 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 15:22:26.057696 16331 mini_ranger_kms.cc:310] Created kms service
I20260807 15:22:26.312018 16331 mini_ranger_kms.cc:326] Created kudu user
I20260807 15:22:26.367575 16331 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 15:22:26 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116143, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:26.813445 16331 mini_ranger_kms.cc:384] Added ranger policy
I20260807 15:22:26.813599 16331 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms:/tmp/dist-test-taskB0Q6oi/build/debug/bin/postgresql.jar:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskB0Q6oi/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 15:22:26.813620 16331 mini_ranger_kms.cc:240] Using host: 127.15.242.212
I20260807 15:22:26.818630 16331 mini_ranger_kms.cc:276] Ranger KMS PID: 2600
I20260807 15:22:26.818727 16331 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.242.212:57031
Aug 07, 2026 3:22:27 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 3:22:27 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 3:22:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 3:22:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 3:22:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 3:22:28 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 15:22:29 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786116149, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.242.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 15:22:29 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116149, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.242.212@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:29.644608 16331 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.104s user 0.006s sys 0.179s
I20260807 15:22:29.644757 16331 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 15:22:29.644991 16331 mini_ranger_kms.cc:401] 127.15.242.212:57031/kms/v1/keys
Aug 07 15:22:30 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116149, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.242.212@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
Aug 07 15:22:32 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:22:32.469151 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38785
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38785
--ranger_config_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:57031/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:32.591825 2674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:32.592084 2674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:32.592126 2674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:32.596412 2674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:32.596467 2674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:32.596486 2674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:32.596503 2674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:32.596518 2674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:32.602085 2674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.242.212:57031/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38785
--ranger_config_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:32.603081 2674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:32.604059 2674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:32.613257 2686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:32.613270 2674 server_base.cc:1034] running on GCE node
W20260807 15:22:32.613291 2683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:32.613313 2680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:32.614143 2674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:32.615235 2674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:32.616460 2674 hybrid_clock.cc:648] HybridClock initialized: now 1786116152616423 us; error 52 us; skew 500 ppm
Aug 07 15:22:32 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:32.623381 2674 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:22:32.624392 2674 webserver.cc:460] Webserver started at http://127.15.242.254:39417/ using document root <none> and password file <none>
I20260807 15:22:32.625042 2674 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:32.625106 2674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:32.625308 2674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 15:22:32 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:32.677352 2674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193"
format_stamp: "Formatted at 2026-08-07 15:22:32 on dist-test-slave-g170"
server_key: "d09fcebdb0882e6489dc7732047b74cb"
server_key_iv: "16325fbf3f8bfee8f3007e3f44e1baca"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:32.677966 2674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193"
format_stamp: "Formatted at 2026-08-07 15:22:32 on dist-test-slave-g170"
server_key: "d09fcebdb0882e6489dc7732047b74cb"
server_key_iv: "16325fbf3f8bfee8f3007e3f44e1baca"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:32.682554 2674 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:22:32.698788 2696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:32.700579 2674 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:22:32.700736 2674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193"
format_stamp: "Formatted at 2026-08-07 15:22:32 on dist-test-slave-g170"
server_key: "d09fcebdb0882e6489dc7732047b74cb"
server_key_iv: "16325fbf3f8bfee8f3007e3f44e1baca"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:32.700914 2674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:32.740439 2674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:32.743549 2674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:32.744011 2674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:32.751858 2674 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38785
I20260807 15:22:32.751889 2769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38785 every 8 connection(s)
I20260807 15:22:32.752904 2674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:22:32.755913 2770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:32.758544 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 2674
I20260807 15:22:32.758687 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:22:32.759037 16331 external_mini_cluster.cc:1428] Setting key fab5e4979aa2044ea3f65d182e515ee1
I20260807 15:22:32.762542 2770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Bootstrap starting.
I20260807 15:22:32.764923 2770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:32.765681 2770 log.cc:824] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:32.767603 2770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: No bootstrap required, opened a new log
Aug 07 15:22:32 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:32.771518 2770 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } }
I20260807 15:22:32.771785 2770 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:32.771872 2770 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c9ee3b6c3b64f42bb0afd8bbc0ad193, State: Initialized, Role: FOLLOWER
I20260807 15:22:32.772403 2770 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } }
I20260807 15:22:32.772563 2770 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:22:32.772652 2770 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:22:32.772790 2770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:32.773795 2774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:32.760595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46044 (local address 127.15.242.254:38785)
0807 15:22:32.761089 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:32.761105 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:32.761144 (+ 39us) server_negotiation.cc:407] Connection header received
0807 15:22:32.761857 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:32.761877 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:32.762220 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:32.762577 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:32.763451 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:32.764441 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:32.765461 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:32.765987 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:32.766154 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:32.768731 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:32.768737 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:32.768752 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:32.768823 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:32.770663 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:32.771192 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:32.771199 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:32.771207 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:32.771346 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:32.771656 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:32.771661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:32.771662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:32.772176 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:32.772409 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:32.772723 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 15:22:32.773064 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":167,"threads_started":1}
I20260807 15:22:32.773799 2770 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } }
I20260807 15:22:32.774227 2770 leader_election.cc:302] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c9ee3b6c3b64f42bb0afd8bbc0ad193; no voters:
I20260807 15:22:32.774552 2770 leader_election.cc:288] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:22:32.774662 2778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:22:32.774919 2778 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 1 LEADER]: Becoming Leader. State: Replica: 6c9ee3b6c3b64f42bb0afd8bbc0ad193, State: Running, Role: LEADER
I20260807 15:22:32.775286 2778 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } }
I20260807 15:22:32.775951 2770 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:22:32.776441 2778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c9ee3b6c3b64f42bb0afd8bbc0ad193. Latest consensus state: current_term: 1 leader_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } } }
I20260807 15:22:32.776490 2779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } } }
I20260807 15:22:32.776564 2778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:32.776652 2779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:32.777134 2783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:22:32.780611 2783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:22:32.781045 2770 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 15:22:32.790963 2783 catalog_manager.cc:1347] Generated new cluster ID: 550b6268a1994f6a90a009feb9527e56
I20260807 15:22:32.791054 2783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:22:32.802326 2783 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:22:32.803419 2783 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:22:32.810294 2783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Generated new TSK 0
I20260807 15:22:32.811023 2783 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:22:33.556314 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38785
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:33.707283 2826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:33.707634 2826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:33.707715 2826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:33.711966 2826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:33.712047 2826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:33.712152 2826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:22:33.718941 2826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.242.212:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:33.720384 2826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:33.721784 2826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:33.734426 2840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:33.734427 2844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:33.734665 2826 server_base.cc:1034] running on GCE node
W20260807 15:22:33.734447 2838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:33.735312 2826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:33.736068 2826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:33.737248 2826 hybrid_clock.cc:648] HybridClock initialized: now 1786116153737229 us; error 37 us; skew 500 ppm
Aug 07 15:22:33 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:33.740391 2826 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:22:33.741546 2826 webserver.cc:460] Webserver started at http://127.15.242.193:44559/ using document root <none> and password file <none>
I20260807 15:22:33.742151 2826 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:33.742249 2826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:33.742502 2826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 15:22:33 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:33.779309 2826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "d6f53aea69aa4175bbc886d5023bc343"
format_stamp: "Formatted at 2026-08-07 15:22:33 on dist-test-slave-g170"
server_key: "fafb0fe495e4a0ac08ec1a9f4c4aeec1"
server_key_iv: "1ffc83b9a94c4f656f557b9054a2eaef"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:33.781888 2826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "d6f53aea69aa4175bbc886d5023bc343"
format_stamp: "Formatted at 2026-08-07 15:22:33 on dist-test-slave-g170"
server_key: "fafb0fe495e4a0ac08ec1a9f4c4aeec1"
server_key_iv: "1ffc83b9a94c4f656f557b9054a2eaef"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:33.790361 2826 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.000s
I20260807 15:22:33.810019 2856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:33.812373 2826 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260807 15:22:33.812547 2826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "d6f53aea69aa4175bbc886d5023bc343"
format_stamp: "Formatted at 2026-08-07 15:22:33 on dist-test-slave-g170"
server_key: "fafb0fe495e4a0ac08ec1a9f4c4aeec1"
server_key_iv: "1ffc83b9a94c4f656f557b9054a2eaef"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:33.812721 2826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:33.838528 2826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:33.842698 2826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:33.842999 2826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:33.843837 2826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:33.844990 2826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:33.845054 2826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:33.845119 2826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:33.845194 2826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:33.857884 2826 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:44885
I20260807 15:22:33.859268 2826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:22:33.860939 3019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:44885 every 8 connection(s)
Aug 07 15:22:33 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786116153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:33.868239 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 2826
I20260807 15:22:33.868394 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:22:33.868960 16331 external_mini_cluster.cc:1428] Setting key d0d125cebfce8a8622c630b56660c4eb
Aug 07 15:22:33 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:33.882860 3023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:33.862660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38785 (local address 127.15.242.193:33553)
0807 15:22:33.863283 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:33.863342 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:33.864455 (+ 1113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:33.867108 (+ 2653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:33.867118 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:33.867510 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:33.868295 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:33.868318 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:33.869611 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:33.869615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:33.872564 (+ 2949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:33.872579 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:33.873499 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:33.873504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:33.873737 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:33.874516 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:33.874546 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:33.876489 (+ 1943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:33.879098 (+ 2609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:33.879118 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:33.879138 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:33.879517 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:33.879857 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:33.879861 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:33.879863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:33.880055 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:33.880571 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:33.880579 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:33.880961 (+ 382us) client_negotiation.cc:769] Sending connection context
0807 15:22:33.881202 (+ 241us) client_negotiation.cc:240] Negotiation successful
0807 15:22:33.881635 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":155,"threads_started":1}
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:22:33.884056 3022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:33.861986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:33553 (local address 127.15.242.254:38785)
0807 15:22:33.866643 (+ 4657us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:33.866647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:33.866672 (+ 25us) server_negotiation.cc:407] Connection header received
0807 15:22:33.866717 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:33.866719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:33.866764 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:33.866885 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:33.868552 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:33.869440 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:33.872785 (+ 3345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:33.873149 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:33.873278 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:33.876719 (+ 3441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:33.876724 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:33.876727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:33.876755 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:33.878954 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:33.879647 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:33.879651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:33.879653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:33.879750 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:33.880182 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:33.880186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:33.880188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:33.880423 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:33.880506 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:33.883708 (+ 3202us) server_negotiation.cc:299] Negotiation successful
0807 15:22:33.883857 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4567,"thread_start_us":72,"threads_started":1}
I20260807 15:22:33.886502 3020 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38785
I20260807 15:22:33.886898 3020 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:33.887607 3020 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:22:33.889693 2719 ts_manager.cc:194] Registered new tserver with Master: d6f53aea69aa4175bbc886d5023bc343 (127.15.242.193:44885)
I20260807 15:22:33.891402 2719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:33553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:22:33.912654 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38785
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:34.086618 3028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:34.087044 3028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:34.087195 3028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:34.093504 3028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:34.093586 3028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:34.093676 3028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:22:34.102167 3028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.242.212:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:34.103705 3028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:34.105234 3028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:34.119249 3035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:34.119324 3034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:34.119429 3037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:34.120815 3028 server_base.cc:1034] running on GCE node
I20260807 15:22:34.121318 3028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:34.122110 3028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:34.125403 3028 hybrid_clock.cc:648] HybridClock initialized: now 1786116154125360 us; error 55 us; skew 500 ppm
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116154, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:34.128475 3028 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:22:34.129595 3028 webserver.cc:460] Webserver started at http://127.15.242.194:45039/ using document root <none> and password file <none>
I20260807 15:22:34.130380 3028 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:34.130477 3028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:34.130749 3028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116154, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:34.150249 3028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "76f4af1b1aca45aa81dc2530ecf6c971"
format_stamp: "Formatted at 2026-08-07 15:22:34 on dist-test-slave-g170"
server_key: "1f39b494c227dbd0a2d84a01d0c8cf50"
server_key_iv: "76dcadcf314d63c5dd916e93aa7d2c5f"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:34.151124 3028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "76f4af1b1aca45aa81dc2530ecf6c971"
format_stamp: "Formatted at 2026-08-07 15:22:34 on dist-test-slave-g170"
server_key: "1f39b494c227dbd0a2d84a01d0c8cf50"
server_key_iv: "76dcadcf314d63c5dd916e93aa7d2c5f"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:34.159555 3028 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260807 15:22:34.177940 3046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:34.179876 3028 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 15:22:34.180115 3028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "76f4af1b1aca45aa81dc2530ecf6c971"
format_stamp: "Formatted at 2026-08-07 15:22:34 on dist-test-slave-g170"
server_key: "1f39b494c227dbd0a2d84a01d0c8cf50"
server_key_iv: "76dcadcf314d63c5dd916e93aa7d2c5f"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:34.180362 3028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:34.212392 3028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:34.216380 3028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:34.216631 3028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:34.217496 3028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:34.218677 3028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:34.218768 3028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:34.218859 3028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:34.218920 3028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:34.231047 3028 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:42591
I20260807 15:22:34.231112 3206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:42591 every 8 connection(s)
I20260807 15:22:34.232285 3028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:22:34.235091 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 3028
I20260807 15:22:34.235260 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:22:34.235617 16331 external_mini_cluster.cc:1428] Setting key 35139ebee80df1fa88f2602bfae2e57a
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116154, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:34.250728 3022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:34.234519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:48847 (local address 127.15.242.254:38785)
0807 15:22:34.234656 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:34.234670 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:34.235709 (+ 1039us) server_negotiation.cc:407] Connection header received
0807 15:22:34.236971 (+ 1262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:34.236974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:34.237022 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:34.237079 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:34.238840 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:34.239737 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:34.241193 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:34.241588 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:34.241688 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:34.245767 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:34.245772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:34.245774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:34.245807 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:34.247862 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:34.248595 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:34.248601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:34.248603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:34.248715 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:34.249192 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:34.249197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:34.249201 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:34.249458 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:34.249554 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:34.250360 (+ 806us) server_negotiation.cc:299] Negotiation successful
0807 15:22:34.250516 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:22:34.252290 3209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:34.234972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38785 (local address 127.15.242.194:48847)
0807 15:22:34.235538 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:34.235590 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:34.236703 (+ 1113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:34.237503 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:34.237513 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:34.237890 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:34.238644 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:34.238675 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:34.239929 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:34.239934 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:34.241039 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:34.241053 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:34.241915 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:34.241921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:34.242151 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:34.243342 (+ 1191us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:34.243368 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:34.245516 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:34.248029 (+ 2513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:34.248038 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:34.248060 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:34.248449 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:34.248865 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:34.248869 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:34.248874 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:34.249066 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:34.249636 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:34.249642 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:34.250021 (+ 379us) client_negotiation.cc:769] Sending connection context
0807 15:22:34.250926 (+ 905us) client_negotiation.cc:240] Negotiation successful
0807 15:22:34.251308 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":137,"threads_started":1}
I20260807 15:22:34.253645 3207 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38785
I20260807 15:22:34.253908 3207 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:34.254437 3207 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:22:34.255571 2719 ts_manager.cc:194] Registered new tserver with Master: 76f4af1b1aca45aa81dc2530ecf6c971 (127.15.242.194:42591)
I20260807 15:22:34.256151 2719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:48847
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:22:34.282130 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38785
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116153, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
W20260807 15:22:34.455185 3213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:34.455646 3213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:34.455771 3213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:34.462018 3213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:34.462208 3213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:34.462368 3213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:22:34.470880 3213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.242.212:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:34.472623 3213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:34.474195 3213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:34.488658 3222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:34.489288 3220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:34.489620 3226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:34.490985 3213 server_base.cc:1034] running on GCE node
I20260807 15:22:34.491699 3213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:34.492560 3213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:34.495887 3213 hybrid_clock.cc:648] HybridClock initialized: now 1786116154495799 us; error 97 us; skew 500 ppm
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116154, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:34.500018 3213 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:22:34.501266 3213 webserver.cc:460] Webserver started at http://127.15.242.195:35991/ using document root <none> and password file <none>
I20260807 15:22:34.502079 3213 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:34.502254 3213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:34.502597 3213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116154, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:34.525684 3213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "e85ee85ae67c400aa08649dc1966715e"
format_stamp: "Formatted at 2026-08-07 15:22:34 on dist-test-slave-g170"
server_key: "35a5f30797d00ecfd181678c656f2662"
server_key_iv: "1a20d891b8582d8d6698b27facb0c27d"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:34.526600 3213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "e85ee85ae67c400aa08649dc1966715e"
format_stamp: "Formatted at 2026-08-07 15:22:34 on dist-test-slave-g170"
server_key: "35a5f30797d00ecfd181678c656f2662"
server_key_iv: "1a20d891b8582d8d6698b27facb0c27d"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:34.532569 3213 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.003s
I20260807 15:22:34.554425 3236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:34.556157 3213 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.000s
I20260807 15:22:34.556299 3213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "e85ee85ae67c400aa08649dc1966715e"
format_stamp: "Formatted at 2026-08-07 15:22:34 on dist-test-slave-g170"
server_key: "35a5f30797d00ecfd181678c656f2662"
server_key_iv: "1a20d891b8582d8d6698b27facb0c27d"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:34.556434 3213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:34.594681 3213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:34.598932 3213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:34.599241 3213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:34.600113 3213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:34.601418 3213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:34.601545 3213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:34.601666 3213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:34.601743 3213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:34.615302 3213 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:46219
I20260807 15:22:34.617921 3213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:22:34.620512 3408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:46219 every 8 connection(s)
I20260807 15:22:34.623842 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 3213
I20260807 15:22:34.623983 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:22:34.624321 16331 external_mini_cluster.cc:1428] Setting key 1f8fd92dbdfa24e5fbab4da64f450c48
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116154, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:34.638341 3022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:34.622478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:34481 (local address 127.15.242.254:38785)
0807 15:22:34.622619 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:34.622624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:34.624446 (+ 1822us) server_negotiation.cc:407] Connection header received
0807 15:22:34.625761 (+ 1315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:34.625765 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:34.625829 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:34.625885 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:34.627555 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:34.628397 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:34.630140 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:34.630494 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:34.630571 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:34.633730 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:34.633735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:34.633737 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:34.633765 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:34.635559 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:34.636185 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:34.636189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:34.636191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:34.636275 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:34.636664 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:34.636668 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:34.636670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:34.636952 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:34.637043 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:34.637993 (+ 950us) server_negotiation.cc:299] Negotiation successful
0807 15:22:34.638128 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 15:22:34.640594 3414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:34.623028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38785 (local address 127.15.242.195:34481)
0807 15:22:34.624271 (+ 1243us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:34.624332 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:34.625521 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:34.626299 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:34.626307 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:34.626684 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:34.627370 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:34.627390 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:34.628563 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:34.628566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:34.629998 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:34.630009 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:34.630793 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:34.630797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:34.630996 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:34.631707 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:34.631727 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:34.633539 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:34.635704 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:34.635710 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:34.635728 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:34.636067 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:34.636383 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:34.636386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:34.636388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:34.636553 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:34.637115 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:34.637125 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:34.637661 (+ 536us) client_negotiation.cc:769] Sending connection context
0807 15:22:34.639066 (+ 1405us) client_negotiation.cc:240] Negotiation successful
0807 15:22:34.639484 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1010,"thread_start_us":147,"threads_started":1}
I20260807 15:22:34.642189 3410 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38785
I20260807 15:22:34.642453 3410 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:34.643040 3410 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
I20260807 15:22:34.644273 2719 ts_manager.cc:194] Registered new tserver with Master: e85ee85ae67c400aa08649dc1966715e (127.15.242.195:46219)
I20260807 15:22:34.645061 2719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:34481
I20260807 15:22:34.650701 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:22:34.651612 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 2826
I20260807 15:22:34.714419 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 3028
I20260807 15:22:34.729921 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 3213
I20260807 15:22:34.741783 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 2674
I20260807 15:22:34.761752 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38785
--webserver_interface=127.15.242.254
--webserver_port=39417
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38785
--ranger_config_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:57031/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.242.212:57031/kms with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:34.887209 3415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:34.887516 3415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:34.887562 3415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:34.891929 3415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:34.892004 3415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:34.892023 3415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:34.892040 3415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:34.892055 3415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:34.897781 3415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.242.212:57031/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38785
--ranger_config_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=39417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:34.898890 3415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:34.899988 3415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:34.909032 3422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:34.909200 3415 server_base.cc:1034] running on GCE node
W20260807 15:22:34.909034 3421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:34.909142 3424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:34.910053 3415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:34.911244 3415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:34.912449 3415 hybrid_clock.cc:648] HybridClock initialized: now 1786116154912415 us; error 49 us; skew 500 ppm
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116154, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:34.915401 3415 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:22:34.916397 3415 webserver.cc:460] Webserver started at http://127.15.242.254:39417/ using document root <none> and password file <none>
I20260807 15:22:34.917047 3415 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:34.917147 3415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 15:22:34 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116154, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:34.966226 3415 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:22:34.968986 3434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:34.970664 3415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:22:34.970844 3415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193"
format_stamp: "Formatted at 2026-08-07 15:22:32 on dist-test-slave-g170"
server_key: "d09fcebdb0882e6489dc7732047b74cb"
server_key_iv: "16325fbf3f8bfee8f3007e3f44e1baca"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:34.971479 3415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:35.001778 3415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:35.005455 3415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:35.005718 3415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:35.014564 3415 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38785
I20260807 15:22:35.014595 3514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38785 every 8 connection(s)
I20260807 15:22:35.015830 3415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:22:35.020676 3515 sys_catalog.cc:263] Verifying existing consensus state
I20260807 15:22:35.021412 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 3415
I20260807 15:22:35.021938 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:44885
--local_ip_for_outbound_sockets=127.15.242.193
--tserver_master_addrs=127.15.242.254:38785
--webserver_port=44559
--webserver_interface=127.15.242.193
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.242.212:57031/kms with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:22:35.022747 3515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Bootstrap starting.
I20260807 15:22:35.041991 3515 log.cc:824] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:35.049561 3515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:22:35.050007 3515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Bootstrap complete.
I20260807 15:22:35.055022 3515 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } }
I20260807 15:22:35.055493 3515 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c9ee3b6c3b64f42bb0afd8bbc0ad193, State: Initialized, Role: FOLLOWER
I20260807 15:22:35.056020 3515 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } }
I20260807 15:22:35.056185 3515 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:22:35.056273 3515 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:22:35.056401 3515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:22:35.058504 3515 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } }
I20260807 15:22:35.058861 3515 leader_election.cc:302] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c9ee3b6c3b64f42bb0afd8bbc0ad193; no voters:
I20260807 15:22:35.059250 3515 leader_election.cc:288] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 15:22:35.059351 3519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:22:35.059603 3519 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [term 2 LEADER]: Becoming Leader. State: Replica: 6c9ee3b6c3b64f42bb0afd8bbc0ad193, State: Running, Role: LEADER
I20260807 15:22:35.060014 3519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } }
I20260807 15:22:35.060652 3515 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:22:35.061074 3519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c9ee3b6c3b64f42bb0afd8bbc0ad193. Latest consensus state: current_term: 2 leader_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } } }
I20260807 15:22:35.061203 3519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:35.061697 3523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:22:35.061652 3520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9ee3b6c3b64f42bb0afd8bbc0ad193" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38785 } } }
I20260807 15:22:35.061930 3520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:35.065563 3523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:22:35.066159 3515 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 15:22:35.066421 3523 catalog_manager.cc:1259] Loaded cluster ID: 550b6268a1994f6a90a009feb9527e56
I20260807 15:22:35.066476 3523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:22:35.069108 3523 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:22:35.069846 3523 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Loaded TSK: 0
I20260807 15:22:35.071201 3523 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 15:22:35.184568 3517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:35.184981 3517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:35.185055 3517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:35.191694 3517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:35.191846 3517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:35.191989 3517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:22:35.200601 3517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.242.212:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:44885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=44559
--tserver_master_addrs=127.15.242.254:38785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:35.202004 3517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:35.203341 3517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:35.217288 3574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:35.217311 3570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:35.217975 3571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:35.218199 3517 server_base.cc:1034] running on GCE node
I20260807 15:22:35.218725 3517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:35.219599 3517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:35.227056 3517 hybrid_clock.cc:648] HybridClock initialized: now 1786116155226956 us; error 113 us; skew 500 ppm
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:35.231295 3517 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:22:35.232630 3517 webserver.cc:460] Webserver started at http://127.15.242.193:44559/ using document root <none> and password file <none>
I20260807 15:22:35.233569 3517 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:35.233846 3517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:35.255084 3517 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:22:35.263705 3584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:35.265614 3517 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260807 15:22:35.265839 3517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "d6f53aea69aa4175bbc886d5023bc343"
format_stamp: "Formatted at 2026-08-07 15:22:33 on dist-test-slave-g170"
server_key: "fafb0fe495e4a0ac08ec1a9f4c4aeec1"
server_key_iv: "1ffc83b9a94c4f656f557b9054a2eaef"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:35.266741 3517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:35.294902 3517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:35.299376 3517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:35.299681 3517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:35.300576 3517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:35.301865 3517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:35.302000 3517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 15:22:35.302345 3517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:35.302449 3517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:35.315333 3517 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:44885
I20260807 15:22:35.315683 3746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:44885 every 8 connection(s)
I20260807 15:22:35.316797 3517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:22:35.322928 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 3517
I20260807 15:22:35.323446 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:42591
--local_ip_for_outbound_sockets=127.15.242.194
--tserver_master_addrs=127.15.242.254:38785
--webserver_port=45039
--webserver_interface=127.15.242.194
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.242.212:57031/kms with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:35.357225 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:35.320165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:60799 (local address 127.15.242.254:38785)
0807 15:22:35.335288 (+ 15123us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:35.335316 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:35.335374 (+ 58us) server_negotiation.cc:407] Connection header received
0807 15:22:35.335735 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:35.335754 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:35.336277 (+ 523us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:35.336711 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:35.338512 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.340513 (+ 2001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.344368 (+ 3855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.345240 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.345424 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:35.349894 (+ 4470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:35.349904 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:35.349930 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:35.349973 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:35.352675 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:35.353537 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:35.353546 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:35.353553 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:35.353712 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:35.354243 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:35.354248 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:35.354250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:35.354829 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:35.354994 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:35.355804 (+ 810us) server_negotiation.cc:299] Negotiation successful
0807 15:22:35.356145 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14895,"thread_start_us":136,"threads_started":1}
I20260807 15:22:35.357241 3751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:35.320204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38785 (local address 127.15.242.193:60799)
0807 15:22:35.333193 (+ 12989us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:35.333280 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:35.334568 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:35.336929 (+ 2361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:35.336941 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:35.337388 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:35.338227 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:35.338256 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.342599 (+ 4343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.342604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:35.344194 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:35.344207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.346589 (+ 2382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.346602 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:35.346858 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:35.347647 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:35.347678 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:35.349577 (+ 1899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:35.352897 (+ 3320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:35.352907 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:35.352926 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:35.353362 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:35.353867 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:35.353871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:35.353873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:35.354088 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:35.354991 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:35.355000 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:35.355366 (+ 366us) client_negotiation.cc:769] Sending connection context
0807 15:22:35.355618 (+ 252us) client_negotiation.cc:240] Negotiation successful
0807 15:22:35.356030 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12676,"thread_start_us":145,"threads_started":1}
I20260807 15:22:35.360824 3747 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38785
I20260807 15:22:35.361115 3747 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:35.361742 3747 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
W20260807 15:22:35.364302 3747 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:38785 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 15:22:35.364444 3747 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:35.364636 3747 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
I20260807 15:22:35.365856 3747 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:35.366067 3747 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
W20260807 15:22:35.367027 3747 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 15:22:35.482847 3754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:35.483386 3754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:35.483505 3754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:35.488731 3754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:35.488865 3754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:35.488966 3754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:22:35.495676 3754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.242.212:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:42591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=45039
--tserver_master_addrs=127.15.242.254:38785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:35.497009 3754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:35.498461 3754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:35.512367 3762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:35.513278 3765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:35.513523 3761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:35.514904 3754 server_base.cc:1034] running on GCE node
I20260807 15:22:35.515461 3754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:35.516356 3754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:35.517570 3754 hybrid_clock.cc:648] HybridClock initialized: now 1786116155517530 us; error 54 us; skew 500 ppm
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:35.521633 3754 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:22:35.522859 3754 webserver.cc:460] Webserver started at http://127.15.242.194:45039/ using document root <none> and password file <none>
I20260807 15:22:35.523744 3754 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:35.523931 3754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:35.544922 3754 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 15:22:35.557724 3780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:35.559664 3754 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.000s
I20260807 15:22:35.559823 3754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "76f4af1b1aca45aa81dc2530ecf6c971"
format_stamp: "Formatted at 2026-08-07 15:22:34 on dist-test-slave-g170"
server_key: "1f39b494c227dbd0a2d84a01d0c8cf50"
server_key_iv: "76dcadcf314d63c5dd916e93aa7d2c5f"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:35.560585 3754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:35.587323 3754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:35.593070 3754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:35.593289 3754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:35.594125 3754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:35.595294 3754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:35.595424 3754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:35.595548 3754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:35.595630 3754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:35.607475 3754 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:42591
I20260807 15:22:35.607599 3946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:42591 every 8 connection(s)
I20260807 15:22:35.608966 3754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:22:35.615729 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 3754
I20260807 15:22:35.616277 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.242.212:57031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:46219
--local_ip_for_outbound_sockets=127.15.242.195
--tserver_master_addrs=127.15.242.254:38785
--webserver_port=35991
--webserver_interface=127.15.242.195
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:40677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.242.212:57031/kms with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:35.626412 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:35.610922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:39295 (local address 127.15.242.254:38785)
0807 15:22:35.611063 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:35.611068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:35.612097 (+ 1029us) server_negotiation.cc:407] Connection header received
0807 15:22:35.613112 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:35.613118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:35.613189 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:35.613307 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:35.614613 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.615455 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.617651 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.618060 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.618190 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:35.621374 (+ 3184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:35.621379 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:35.621382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:35.621416 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:35.623274 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:35.624034 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:35.624041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:35.624044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:35.624150 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:35.624713 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:35.624721 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:35.624725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:35.625041 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:35.625146 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:35.625992 (+ 846us) server_negotiation.cc:299] Negotiation successful
0807 15:22:35.626168 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:22:35.628712 3949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:35.611412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38785 (local address 127.15.242.194:39295)
0807 15:22:35.611909 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:35.611962 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:35.612882 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:35.613466 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:35.613473 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:35.613749 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:35.614423 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:35.614443 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.615976 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.615980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:35.617500 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:35.617516 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.618410 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.618414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:35.618660 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:35.619431 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:35.619455 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:35.621165 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:35.623426 (+ 2261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:35.623437 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:35.623457 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:35.623890 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:35.624283 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:35.624288 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:35.624292 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:35.624506 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:35.625228 (+ 722us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:35.625238 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:35.625646 (+ 408us) client_negotiation.cc:769] Sending connection context
0807 15:22:35.626889 (+ 1243us) client_negotiation.cc:240] Negotiation successful
0807 15:22:35.627301 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":148,"threads_started":1}
I20260807 15:22:35.630439 3947 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38785
I20260807 15:22:35.630730 3947 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:35.631402 3947 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
W20260807 15:22:35.633375 3947 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:38785 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 15:22:35.633497 3947 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:35.633716 3947 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
I20260807 15:22:35.634622 3947 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:35.634788 3947 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
W20260807 15:22:35.635625 3947 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 15:22:35.766355 3951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:35.766744 3951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:35.766852 3951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:35.773186 3951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:35.773295 3951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:35.773420 3951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:22:35.781591 3951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.242.212:57031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:46219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=35991
--tserver_master_addrs=127.15.242.254:38785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:35.783161 3951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:35.784353 3951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:35.798758 3965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:35.799022 3962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:35.799369 3968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:35.799537 3951 server_base.cc:1034] running on GCE node
I20260807 15:22:35.800089 3951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:35.801033 3951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:35.802279 3951 hybrid_clock.cc:648] HybridClock initialized: now 1786116155802248 us; error 48 us; skew 500 ppm
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:35.806316 3951 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:22:35.807557 3951 webserver.cc:460] Webserver started at http://127.15.242.195:35991/ using document root <none> and password file <none>
I20260807 15:22:35.808295 3951 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:35.808418 3951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:35.829447 3951 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:22:35.835898 3981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:35.837909 3951 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.000s
I20260807 15:22:35.838079 3951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "e85ee85ae67c400aa08649dc1966715e"
format_stamp: "Formatted at 2026-08-07 15:22:34 on dist-test-slave-g170"
server_key: "35a5f30797d00ecfd181678c656f2662"
server_key_iv: "1a20d891b8582d8d6698b27facb0c27d"
server_key_version: "kuduclusterkey@0"
I20260807 15:22:35.838927 3951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:35.879506 3951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:35.883368 3951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:35.883601 3951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:35.884424 3951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:35.885658 3951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:35.885728 3951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:35.885792 3951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:35.885826 3951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:35.898876 3951 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:46219
I20260807 15:22:35.899115 4153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:46219 every 8 connection(s)
I20260807 15:22:35.900385 3951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:22:35.909291 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 3951
Aug 07 15:22:35 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:35.920922 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:35.903059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:47037 (local address 127.15.242.254:38785)
0807 15:22:35.903228 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:35.903234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:35.904676 (+ 1442us) server_negotiation.cc:407] Connection header received
0807 15:22:35.906095 (+ 1419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:35.906100 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:35.906166 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:35.906298 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:35.907820 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.908714 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.911564 (+ 2850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.911960 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.912076 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:35.916136 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:35.916141 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:35.916145 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:35.916178 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:35.918111 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:35.918803 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:35.918807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:35.918809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:35.918903 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:35.919389 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:35.919397 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:35.919401 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:35.919670 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:35.919824 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:35.920569 (+ 745us) server_negotiation.cc:299] Negotiation successful
0807 15:22:35.920701 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 15:22:35.922930 4156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:35.903822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38785 (local address 127.15.242.195:47037)
0807 15:22:35.904483 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:35.904547 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:35.905797 (+ 1250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:35.906512 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:35.906522 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:35.906901 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:35.907636 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:35.907656 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.908946 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.908950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:35.911409 (+ 2459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:35.911424 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.912182 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.912213 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:35.913126 (+ 913us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:35.913963 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:35.913989 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:35.915921 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:35.918251 (+ 2330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:35.918267 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:35.918285 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:35.918681 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:35.919030 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:35.919036 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:35.919039 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:35.919257 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:35.919828 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:35.919838 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:35.920206 (+ 368us) client_negotiation.cc:769] Sending connection context
0807 15:22:35.921375 (+ 1169us) client_negotiation.cc:240] Negotiation successful
0807 15:22:35.921770 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":171,"threads_started":1}
I20260807 15:22:35.924033 4158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:35.910151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46056 (local address 127.15.242.254:38785)
0807 15:22:35.910499 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:35.910511 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:35.912173 (+ 1662us) server_negotiation.cc:407] Connection header received
0807 15:22:35.912206 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:35.912209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:35.912266 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:35.912348 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:35.913899 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.914743 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.917172 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:35.918438 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:35.918544 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:35.920336 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:35.920340 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:35.920343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:35.920373 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:35.922062 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:35.922548 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:35.922552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:35.922554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:35.922648 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:35.922976 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:35.922980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:35.922982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:35.923178 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:35.923405 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:35.923637 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 15:22:35.923834 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":153,"threads_started":1}
I20260807 15:22:35.924728 4154 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38785
I20260807 15:22:35.925046 4154 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:35.925763 4154 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
I20260807 15:22:35.927282 3455 ts_manager.cc:194] Registered new tserver with Master: e85ee85ae67c400aa08649dc1966715e (127.15.242.195:46219)
I20260807 15:22:35.928547 3455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:47037
Aug 07 15:22:36 dist-test-slave-g170 krb5kdc[2008](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786116156, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:36.367270 3747 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:36.367658 3747 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
I20260807 15:22:36.368652 3455 ts_manager.cc:194] Registered new tserver with Master: d6f53aea69aa4175bbc886d5023bc343 (127.15.242.193:44885)
I20260807 15:22:36.369642 3455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:60799
Aug 07 15:22:36 dist-test-slave-g170 krb5kdc[2008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116156, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for HTTP/127.15.242.212@KRBTEST.COM
I20260807 15:22:36.635996 3947 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:36.636303 3947 heartbeater.cc:511] Master 127.15.242.254:38785 requested a full tablet report, sending...
I20260807 15:22:36.637256 3455 ts_manager.cc:194] Registered new tserver with Master: 76f4af1b1aca45aa81dc2530ecf6c971 (127.15.242.194:42591)
I20260807 15:22:36.638015 3455 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:39295
I20260807 15:22:36.641649 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:22:36.660126 4179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.645173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57202 (local address 127.15.242.254:38785)
0807 15:22:36.648895 (+ 3722us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:36.648900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:36.648915 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:22:36.650039 (+ 1124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:36.650043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:36.650103 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:36.650220 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:36.651126 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.651949 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.653343 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.653700 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.653802 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.655715 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:36.655719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:36.655722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:36.655748 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:36.657676 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:36.658219 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:36.658223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:36.658226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:36.658330 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:36.658656 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:36.658660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:36.658662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:36.658891 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:36.659024 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:36.659809 (+ 785us) server_negotiation.cc:299] Negotiation successful
0807 15:22:36.659944 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3448,"thread_start_us":102,"threads_started":1}
I20260807 15:22:36.664927 3455 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57202:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:22:36.670346 3455 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:22:36.698590 4187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.688006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:46219 (local address 127.0.0.1:55462)
0807 15:22:36.692839 (+ 4833us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:36.692853 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:36.692960 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:36.693605 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:36.693608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:36.693625 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:36.693714 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.693720 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.695179 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.695183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.696604 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.696616 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.697967 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.697971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.698085 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.698125 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 15:22:36.698299 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 15:22:36.698436 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4746,"thread_start_us":90,"threads_started":1}
I20260807 15:22:36.700502 4188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.687736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:44885 (local address 127.0.0.1:34714)
0807 15:22:36.691416 (+ 3680us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:36.691470 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:36.691616 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:36.692528 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:36.692535 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:36.692564 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:36.692719 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.692728 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.696377 (+ 3649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.696381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.697723 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.697737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.700053 (+ 2316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.700057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.700168 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.700194 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 15:22:36.700275 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 15:22:36.700349 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3474,"thread_start_us":139,"threads_started":1}
I20260807 15:22:36.701357 4190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.689281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34714 (local address 127.15.242.193:44885)
0807 15:22:36.690945 (+ 1664us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:36.690953 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:36.691782 (+ 829us) server_negotiation.cc:407] Connection header received
0807 15:22:36.691877 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:36.691883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:36.692130 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:36.692315 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:36.692897 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.696214 (+ 3317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.697900 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.699626 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.699758 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.699891 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:36.701034 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0807 15:22:36.701185 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1541,"thread_start_us":103,"threads_started":1}
I20260807 15:22:36.701833 4189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.688682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55462 (local address 127.15.242.195:46219)
0807 15:22:36.692668 (+ 3986us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:36.692675 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:36.693057 (+ 382us) server_negotiation.cc:407] Connection header received
0807 15:22:36.693137 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:36.693141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:36.693338 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:36.693471 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:36.693839 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.695036 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.696754 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.697630 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.697752 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.697897 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:36.701589 (+ 3692us) server_negotiation.cc:299] Negotiation successful
0807 15:22:36.701692 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3874,"thread_start_us":121,"threads_started":1}
I20260807 15:22:36.704981 4187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.688631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:42591 (local address 127.0.0.1:45598)
0807 15:22:36.699182 (+ 10551us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:36.699207 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:36.699278 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:36.699921 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:36.699924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:36.699941 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:36.700007 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.700013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.702074 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.702078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.703226 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.703236 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.704580 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.704584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.704671 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.704695 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 15:22:36.704795 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 15:22:36.704860 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10497,"thread_start_us":142,"threads_started":1}
I20260807 15:22:36.705082 3652 tablet_service.cc:1467] Processing CreateTablet for tablet 44d1b87e58ec4f9daf88eee7efd8d91b (DEFAULT_TABLE table=test-table [id=c8cd0a87d0cd49f3938bb482605e9b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:36.705715 4191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.689658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45598 (local address 127.15.242.194:42591)
0807 15:22:36.691130 (+ 1472us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:36.691136 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:36.699374 (+ 8238us) server_negotiation.cc:407] Connection header received
0807 15:22:36.699458 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:36.699463 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:36.699649 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:36.699785 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:36.700127 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.701438 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.703371 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.704152 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.704282 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.704397 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:36.705484 (+ 1087us) server_negotiation.cc:299] Negotiation successful
0807 15:22:36.705580 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1373,"thread_start_us":122,"threads_started":1}
I20260807 15:22:36.707332 4053 tablet_service.cc:1467] Processing CreateTablet for tablet 44d1b87e58ec4f9daf88eee7efd8d91b (DEFAULT_TABLE table=test-table [id=c8cd0a87d0cd49f3938bb482605e9b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:36.708420 4053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d1b87e58ec4f9daf88eee7efd8d91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:36.708559 3652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d1b87e58ec4f9daf88eee7efd8d91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:36.715607 3845 tablet_service.cc:1467] Processing CreateTablet for tablet 44d1b87e58ec4f9daf88eee7efd8d91b (DEFAULT_TABLE table=test-table [id=c8cd0a87d0cd49f3938bb482605e9b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:36.717461 3845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44d1b87e58ec4f9daf88eee7efd8d91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:36.721410 4192 tablet_bootstrap.cc:492] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343: Bootstrap starting.
I20260807 15:22:36.724164 4192 tablet_bootstrap.cc:654] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:36.725245 4192 log.cc:824] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:36.728169 4192 tablet_bootstrap.cc:492] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343: No bootstrap required, opened a new log
I20260807 15:22:36.728400 4192 ts_tablet_manager.cc:1397] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:22:36.733669 4192 raft_consensus.cc:348] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.734014 4192 raft_consensus.cc:374] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:36.734128 4192 raft_consensus.cc:729] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f53aea69aa4175bbc886d5023bc343, State: Initialized, Role: FOLLOWER
I20260807 15:22:36.734495 4194 tablet_bootstrap.cc:492] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971: Bootstrap starting.
I20260807 15:22:36.734767 4192 consensus_queue.cc:260] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.736022 4192 ts_tablet_manager.cc:1428] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 15:22:36.736462 3747 heartbeater.cc:503] Master 127.15.242.254:38785 was elected leader, sending a full tablet report...
I20260807 15:22:36.737059 4194 tablet_bootstrap.cc:654] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:36.737958 4194 log.cc:824] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:36.738734 4195 tablet_bootstrap.cc:492] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: Bootstrap starting.
I20260807 15:22:36.741772 4195 tablet_bootstrap.cc:654] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:36.742715 4195 log.cc:824] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:36.746421 4195 tablet_bootstrap.cc:492] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: No bootstrap required, opened a new log
I20260807 15:22:36.746644 4195 ts_tablet_manager.cc:1397] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 15:22:36.750748 4194 tablet_bootstrap.cc:492] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971: No bootstrap required, opened a new log
I20260807 15:22:36.750972 4194 ts_tablet_manager.cc:1397] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260807 15:22:36.753883 4195 raft_consensus.cc:348] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.754256 4195 raft_consensus.cc:374] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:36.754364 4195 raft_consensus.cc:729] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e85ee85ae67c400aa08649dc1966715e, State: Initialized, Role: FOLLOWER
I20260807 15:22:36.755241 4195 consensus_queue.cc:260] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.756008 4194 raft_consensus.cc:348] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.756357 4194 raft_consensus.cc:374] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:36.756461 4194 raft_consensus.cc:729] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f4af1b1aca45aa81dc2530ecf6c971, State: Initialized, Role: FOLLOWER
I20260807 15:22:36.756493 4195 ts_tablet_manager.cc:1428] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 15:22:36.756979 4154 heartbeater.cc:503] Master 127.15.242.254:38785 was elected leader, sending a full tablet report...
I20260807 15:22:36.757071 4194 consensus_queue.cc:260] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.758111 4194 ts_tablet_manager.cc:1428] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 15:22:36.758533 3947 heartbeater.cc:503] Master 127.15.242.254:38785 was elected leader, sending a full tablet report...
I20260807 15:22:36.805581 4204 raft_consensus.cc:482] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:22:36.805963 4204 raft_consensus.cc:504] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.808331 4204 leader_election.cc:288] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6f53aea69aa4175bbc886d5023bc343 (127.15.242.193:44885), e85ee85ae67c400aa08649dc1966715e (127.15.242.195:46219)
I20260807 15:22:36.813910 4190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.808448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:37039 (local address 127.15.242.193:44885)
0807 15:22:36.808692 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:36.808697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:36.808892 (+ 195us) server_negotiation.cc:407] Connection header received
0807 15:22:36.809186 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:36.809190 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:36.809251 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:36.809315 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:36.809856 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.810630 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.812330 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.812964 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.813093 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.813153 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:36.813624 (+ 471us) server_negotiation.cc:299] Negotiation successful
0807 15:22:36.813706 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161}
I20260807 15:22:36.814652 4207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.807934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:44885 (local address 127.15.242.194:37039)
0807 15:22:36.808703 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:36.808722 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:36.809001 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:36.809495 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:36.809498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:36.809520 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:36.809692 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.809702 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.810802 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.810806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.812155 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.812171 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.813274 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.813279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.813386 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.813417 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 15:22:36.814389 (+ 972us) client_negotiation.cc:240] Negotiation successful
0807 15:22:36.814473 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":77,"thread_start_us":117,"threads_started":1}
I20260807 15:22:36.814736 4189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.808564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:56449 (local address 127.15.242.195:46219)
0807 15:22:36.808806 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:36.808811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:36.809059 (+ 248us) server_negotiation.cc:407] Connection header received
0807 15:22:36.809253 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:36.809256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:36.809302 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:36.809345 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:36.809861 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.810615 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.812255 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.812851 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.812959 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.813011 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:36.814501 (+ 1490us) server_negotiation.cc:299] Negotiation successful
0807 15:22:36.814616 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260807 15:22:36.815264 4205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.808017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:46219 (local address 127.15.242.194:56449)
0807 15:22:36.808977 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:36.808990 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:36.809138 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:36.809483 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:36.809486 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:36.809502 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:36.809724 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.809731 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.810768 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.810771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.812099 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:36.812110 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.814256 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.814259 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:36.814361 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.814384 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 15:22:36.814918 (+ 534us) client_negotiation.cc:240] Negotiation successful
0807 15:22:36.814992 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":16,"spinlock_wait_cycles":41344,"thread_start_us":133,"threads_started":1}
I20260807 15:22:36.815632 3673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d1b87e58ec4f9daf88eee7efd8d91b" candidate_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6f53aea69aa4175bbc886d5023bc343" is_pre_election: true
I20260807 15:22:36.816015 3673 raft_consensus.cc:2454] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f4af1b1aca45aa81dc2530ecf6c971 in term 0.
I20260807 15:22:36.815991 4083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d1b87e58ec4f9daf88eee7efd8d91b" candidate_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e85ee85ae67c400aa08649dc1966715e" is_pre_election: true
I20260807 15:22:36.816313 4083 raft_consensus.cc:2454] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f4af1b1aca45aa81dc2530ecf6c971 in term 0.
I20260807 15:22:36.816875 3781 leader_election.cc:302] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 76f4af1b1aca45aa81dc2530ecf6c971, d6f53aea69aa4175bbc886d5023bc343, e85ee85ae67c400aa08649dc1966715e; no voters:
I20260807 15:22:36.817179 4204 raft_consensus.cc:2781] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:22:36.817257 4204 raft_consensus.cc:482] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:22:36.817310 4204 raft_consensus.cc:3037] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:36.818429 4204 raft_consensus.cc:504] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.818842 4204 leader_election.cc:288] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [CANDIDATE]: Term 1 election: Requested vote from peers d6f53aea69aa4175bbc886d5023bc343 (127.15.242.193:44885), e85ee85ae67c400aa08649dc1966715e (127.15.242.195:46219)
I20260807 15:22:36.819175 3673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d1b87e58ec4f9daf88eee7efd8d91b" candidate_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6f53aea69aa4175bbc886d5023bc343"
I20260807 15:22:36.819320 3673 raft_consensus.cc:3037] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:36.820526 3673 raft_consensus.cc:2454] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f4af1b1aca45aa81dc2530ecf6c971 in term 1.
I20260807 15:22:36.820906 3781 leader_election.cc:302] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f4af1b1aca45aa81dc2530ecf6c971, d6f53aea69aa4175bbc886d5023bc343; no voters:
I20260807 15:22:36.820880 4083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44d1b87e58ec4f9daf88eee7efd8d91b" candidate_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e85ee85ae67c400aa08649dc1966715e"
I20260807 15:22:36.821012 4083 raft_consensus.cc:3037] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:36.821151 4204 raft_consensus.cc:2781] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:22:36.821398 4204 raft_consensus.cc:686] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 1 LEADER]: Becoming Leader. State: Replica: 76f4af1b1aca45aa81dc2530ecf6c971, State: Running, Role: LEADER
I20260807 15:22:36.821784 4204 consensus_queue.cc:237] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } }
I20260807 15:22:36.822412 4083 raft_consensus.cc:2454] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f4af1b1aca45aa81dc2530ecf6c971 in term 1.
W20260807 15:22:36.825212 3749 tablet.cc:2369] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:22:36.825212 3455 catalog_manager.cc:5495] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76f4af1b1aca45aa81dc2530ecf6c971 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f4af1b1aca45aa81dc2530ecf6c971" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 } health_report { overall_health: UNKNOWN } } }
I20260807 15:22:36.854449 4191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.849965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45612 (local address 127.15.242.194:42591)
0807 15:22:36.850147 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:36.850152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:36.850182 (+ 30us) server_negotiation.cc:407] Connection header received
0807 15:22:36.850286 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:36.850289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:36.850390 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:36.850539 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:22:36.850918 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.851494 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.852783 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:36.853017 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:36.853147 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:36.853494 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:22:36.853953 (+ 459us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:22:36.854096 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:36.854140 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 15:22:36.854205 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 15:22:36.861001 3948 tablet.cc:2369] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:22:36.861580 4083 raft_consensus.cc:1261] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 1 FOLLOWER]: Refusing update from remote peer 76f4af1b1aca45aa81dc2530ecf6c971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:22:36.862468 3673 raft_consensus.cc:1261] T 44d1b87e58ec4f9daf88eee7efd8d91b P d6f53aea69aa4175bbc886d5023bc343 [term 1 FOLLOWER]: Refusing update from remote peer 76f4af1b1aca45aa81dc2530ecf6c971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:22:36.862499 4204 consensus_queue.cc:1035] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e85ee85ae67c400aa08649dc1966715e" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:22:36.863430 4204 consensus_queue.cc:1035] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6f53aea69aa4175bbc886d5023bc343" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:22:36.879573 4211 mvcc.cc:205] Tried to move back new op lower bound from 7315931778495668224 to 7315931778345390080. Current Snapshot: MvccSnapshot[applied={T|T < 7315931778495668224}]
I20260807 15:22:36.882789 4212 mvcc.cc:205] Tried to move back new op lower bound from 7315931778495668224 to 7315931778345390080. Current Snapshot: MvccSnapshot[applied={T|T < 7315931778495668224}]
I20260807 15:22:36.885571 4213 mvcc.cc:205] Tried to move back new op lower bound from 7315931778495668224 to 7315931778345390080. Current Snapshot: MvccSnapshot[applied={T|T < 7315931778495668224}]
I20260807 15:22:36.895503 3454 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:22:36.895731 3454 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:22:36.899175 3454 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c9ee3b6c3b64f42bb0afd8bbc0ad193: Sending DeleteTablet for 3 replicas of tablet 44d1b87e58ec4f9daf88eee7efd8d91b
I20260807 15:22:36.900906 3652 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d1b87e58ec4f9daf88eee7efd8d91b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:36 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:34714
I20260807 15:22:36.901778 3845 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d1b87e58ec4f9daf88eee7efd8d91b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:36 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:45598
I20260807 15:22:36.903745 4053 tablet_service.cc:1514] Processing DeleteTablet for tablet 44d1b87e58ec4f9daf88eee7efd8d91b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:36 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:55462
I20260807 15:22:36.905277 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 3517
I20260807 15:22:36.913034 4226 tablet_replica.cc:330] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971: stopping tablet replica
I20260807 15:22:36.913427 4226 raft_consensus.cc:2229] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:22:36.913836 4226 raft_consensus.cc:2258] T 44d1b87e58ec4f9daf88eee7efd8d91b P 76f4af1b1aca45aa81dc2530ecf6c971 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:22:36.914304 4229 tablet_replica.cc:330] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: stopping tablet replica
I20260807 15:22:36.914613 4229 raft_consensus.cc:2229] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:22:36.915064 4229 raft_consensus.cc:2258] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:22:36.917025 4229 ts_tablet_manager.cc:1905] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:22:36.920867 4229 ts_tablet_manager.cc:1918] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:22:36.923002 4229 log.cc:1196] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/44d1b87e58ec4f9daf88eee7efd8d91b
I20260807 15:22:36.923573 4229 ts_tablet_manager.cc:1939] T 44d1b87e58ec4f9daf88eee7efd8d91b P e85ee85ae67c400aa08649dc1966715e: Deleting consensus metadata
I20260807 15:22:36.925407 3437 catalog_manager.cc:4841] TS e85ee85ae67c400aa08649dc1966715e (127.15.242.195:46219): tablet 44d1b87e58ec4f9daf88eee7efd8d91b (table test-table [id=c8cd0a87d0cd49f3938bb482605e9b82]) successfully deleted
W20260807 15:22:36.927476 3435 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:44885 (error 108)
I20260807 15:22:36.928484 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 3754
I20260807 15:22:36.954728 4187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.954383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:44885 (local address 127.0.0.1:34722)
0807 15:22:36.954521 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:36.954625 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:44885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 15:22:36.955143 3435 catalog_manager.cc:4584] TS d6f53aea69aa4175bbc886d5023bc343 (127.15.242.193:44885): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 44d1b87e58ec4f9daf88eee7efd8d91b: Network error: Client connection negotiation failed: client connection to 127.15.242.193:44885: connect: Connection refused (error 111)
I20260807 15:22:36.958063 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 3951
I20260807 15:22:36.968858 4187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:36.968264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:42591 (local address 127.0.0.1:45628)
0807 15:22:36.968538 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:36.968606 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.194:42591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260807 15:22:36.978912 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 3415
I20260807 15:22:36.997705 16331 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 15:22:37.342684 16331 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 15:22:37.342829 16331 mini_ranger.cc:66] Stopping Ranger...
I20260807 15:22:37.688014 16331 mini_ranger.cc:68] Stopped Ranger
2026-08-07 15:22:37.688 UTC [2047] LOG: received smart shutdown request
2026-08-07 15:22:37.692 UTC [2047] LOG: background worker "logical replication launcher" (PID 2062) exited with exit code 1
2026-08-07 15:22:37.693 UTC [2054] LOG: shutting down
2026-08-07 15:22:37.883 UTC [2047] LOG: database system is shut down
2026-08-07T15:22:37Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52022 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:22:38 dist-test-slave-g170 krb5kdc[4245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:22:38 dist-test-slave-g170 krb5kdc[4245](info): set up 2 sockets
Aug 07 15:22:38 dist-test-slave-g170 krb5kdc[4245](info): commencing operation
krb5kdc: starting...
W20260807 15:22:39.298928 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:22:39 dist-test-slave-g170 krb5kdc[4245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:22:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:22:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:22:39.444535 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:43479
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:43479,127.15.242.253:33209,127.15.242.252:36149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:39.564128 4269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:39.564435 4269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:39.564505 4269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:39.568476 4269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:39.568564 4269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:39.568603 4269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:39.568642 4269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:39.568677 4269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:39.573921 4269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:43479,127.15.242.253:33209,127.15.242.252:36149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:43479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:39.575053 4269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:39.576120 4269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:39.584693 4282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:39.584702 4278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:39.584703 4275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:39.585096 4269 server_base.cc:1034] running on GCE node
I20260807 15:22:39.585700 4269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:39.586917 4269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:39.588114 4269 hybrid_clock.cc:648] HybridClock initialized: now 1786116159588085 us; error 45 us; skew 500 ppm
Aug 07 15:22:39 dist-test-slave-g170 krb5kdc[4245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:39.591054 4269 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:22:39.592061 4269 webserver.cc:460] Webserver started at http://127.15.242.254:38579/ using document root <none> and password file <none>
I20260807 15:22:39.592664 4269 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:39.592839 4269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:39.593093 4269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:22:39.595319 4269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "42e3fa43c0a7487b917de0f6ff0f79d0"
format_stamp: "Formatted at 2026-08-07 15:22:39 on dist-test-slave-g170"
server_key: "865ba309ba3c00af9b997b01534c3a87"
server_key_iv: "b6ebe3574360f62ee240ad8189906465"
server_key_version: "encryptionkey@0"
I20260807 15:22:39.595945 4269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "42e3fa43c0a7487b917de0f6ff0f79d0"
format_stamp: "Formatted at 2026-08-07 15:22:39 on dist-test-slave-g170"
server_key: "865ba309ba3c00af9b997b01534c3a87"
server_key_iv: "b6ebe3574360f62ee240ad8189906465"
server_key_version: "encryptionkey@0"
I20260807 15:22:39.600047 4269 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 15:22:39.602718 4294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:39.604013 4269 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 15:22:39.604162 4269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "42e3fa43c0a7487b917de0f6ff0f79d0"
format_stamp: "Formatted at 2026-08-07 15:22:39 on dist-test-slave-g170"
server_key: "865ba309ba3c00af9b997b01534c3a87"
server_key_iv: "b6ebe3574360f62ee240ad8189906465"
server_key_version: "encryptionkey@0"
I20260807 15:22:39.604285 4269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:39.626549 4269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:39.629835 4269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:39.630053 4269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:39.637930 4269 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:43479
I20260807 15:22:39.638268 4366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:43479 every 8 connection(s)
I20260807 15:22:39.639103 4269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:22:39.641999 4367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:39.642624 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 4269
I20260807 15:22:39.642762 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:22:39.643061 16331 external_mini_cluster.cc:1428] Setting key ac71892390162a85b1b3512b796610ad
I20260807 15:22:39.646332 4367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.242.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.253@KRBTEST.COM" created.
Aug 07 15:22:39 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:39.663116 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.649221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46260 (local address 127.15.242.254:43479)
0807 15:22:39.649848 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:39.649867 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:39.650050 (+ 183us) server_negotiation.cc:407] Connection header received
0807 15:22:39.651518 (+ 1468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:39.651523 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:39.651720 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:39.651888 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:39.653046 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.654062 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.655102 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.655701 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.655835 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:39.658361 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:39.658367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:39.658376 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:39.658396 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:39.660019 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:39.660526 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:39.660530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:39.660532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:39.660632 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:39.660974 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:39.660977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:39.660979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:39.661341 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:39.661479 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:39.661838 (+ 359us) server_negotiation.cc:299] Negotiation successful
0807 15:22:39.662068 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":494,"thread_start_us":169,"threads_started":1}
I20260807 15:22:39.663116 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.649221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:43479 (local address 127.0.0.1:46260)
0807 15:22:39.649864 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.649925 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:39.651164 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:39.651943 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:39.651949 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:39.652424 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:39.652861 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:39.652883 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.654205 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.654208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:39.654982 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:39.654992 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.655867 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.655870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:39.656090 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:39.656793 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:39.656817 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:39.658205 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:39.660162 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:39.660172 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:39.660182 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:39.660409 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:39.660727 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:39.660730 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:39.660732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:39.660885 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:39.661460 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:39.661466 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:39.661600 (+ 134us) client_negotiation.cc:769] Sending connection context
0807 15:22:39.661763 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 15:22:39.662120 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":143,"spinlock_wait_cycles":26496,"thread_start_us":165,"threads_started":1}
I20260807 15:22:39.666218 4367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:22:39.667107 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.666806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47684)
0807 15:22:39.666951 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.667029 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 15:22:39.667349 4298 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
I20260807 15:22:39.668283 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.668056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47700)
0807 15:22:39.668177 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.668226 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 15:22:39.668531 4367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:33209: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab.
Entry for principal kudu/127.15.242.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab.
I20260807 15:22:39.676486 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.253:33209
--webserver_interface=127.15.242.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab
--principal=kudu/127.15.242.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:43479,127.15.242.253:33209,127.15.242.252:36149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:22:39.717835 4367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } attempt: 1
I20260807 15:22:39.718863 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.718526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47704)
0807 15:22:39.718706 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.718778 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 15:22:39.719738 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.719490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47718)
0807 15:22:39.719613 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.719666 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 15:22:39.719884 4367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:33209: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
I20260807 15:22:39.788072 4367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } attempt: 2
I20260807 15:22:39.789083 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.788710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47726)
0807 15:22:39.788924 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.789002 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260807 15:22:39.789836 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.789592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47736)
0807 15:22:39.789709 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.789768 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 15:22:39.789973 4367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:33209: Network error: Client connection negotiation failed: client connection to 127.15.242.253:33209: connect: Connection refused (error 111)
W20260807 15:22:39.796015 4376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:39.796324 4376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:39.796432 4376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:39.800725 4376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:39.800917 4376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:39.800971 4376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:39.801007 4376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:39.801043 4376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:39.806710 4376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:43479,127.15.242.253:33209,127.15.242.252:36149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab
--principal=kudu/127.15.242.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.253:33209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.242.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:39.807943 4376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:39.809231 4376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:39.819605 4387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:39.819634 4384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:39.819607 4385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:39.819681 4376 server_base.cc:1034] running on GCE node
I20260807 15:22:39.820910 4376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:39.822243 4376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:39.823431 4376 hybrid_clock.cc:648] HybridClock initialized: now 1786116159823407 us; error 39 us; skew 500 ppm
Aug 07 15:22:39 dist-test-slave-g170 krb5kdc[4245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:39.826740 4376 init.cc:377] Logged in from keytab as kudu/127.15.242.253@KRBTEST.COM (short username kudu)
I20260807 15:22:39.827905 4376 webserver.cc:460] Webserver started at http://127.15.242.253:43977/ using document root <none> and password file <none>
I20260807 15:22:39.828572 4376 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:39.828686 4376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:39.828975 4376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:22:39.831352 4376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/data/instance:
uuid: "8a8955822b31432590c3829a8081ef76"
format_stamp: "Formatted at 2026-08-07 15:22:39 on dist-test-slave-g170"
server_key: "95b19dc21c38e938b6bf998e7d3950d1"
server_key_iv: "360f0d03620a5584e3ec999358cd4022"
server_key_version: "encryptionkey@0"
I20260807 15:22:39.832013 4376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/wal/instance:
uuid: "8a8955822b31432590c3829a8081ef76"
format_stamp: "Formatted at 2026-08-07 15:22:39 on dist-test-slave-g170"
server_key: "95b19dc21c38e938b6bf998e7d3950d1"
server_key_iv: "360f0d03620a5584e3ec999358cd4022"
server_key_version: "encryptionkey@0"
I20260807 15:22:39.836472 4376 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:22:39.839449 4398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:39.840893 4376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:22:39.841097 4376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/wal
uuid: "8a8955822b31432590c3829a8081ef76"
format_stamp: "Formatted at 2026-08-07 15:22:39 on dist-test-slave-g170"
server_key: "95b19dc21c38e938b6bf998e7d3950d1"
server_key_iv: "360f0d03620a5584e3ec999358cd4022"
server_key_version: "encryptionkey@0"
I20260807 15:22:39.841267 4376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:39.859866 4376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:39.863688 4376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:39.863911 4376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:39.871838 4376 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.253:33209
I20260807 15:22:39.872309 4481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.253:33209 every 8 connection(s)
I20260807 15:22:39.873031 4376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
I20260807 15:22:39.875013 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 4376
I20260807 15:22:39.875207 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-1/wal/instance
I20260807 15:22:39.875523 16331 external_mini_cluster.cc:1428] Setting key bf9bb7e83612c3129c95b3a457137afb
I20260807 15:22:39.876127 4482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:39.880012 4482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:22:39.881132 4367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } attempt: 3
WARNING: no policy specified for kudu/127.15.242.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.252@KRBTEST.COM" created.
Aug 07 15:22:39 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
Aug 07 15:22:39 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:39.895871 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.881710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47740)
0807 15:22:39.882863 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.882881 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:39.882982 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:39.884682 (+ 1700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:39.884688 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:39.884931 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:39.885098 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:39.885107 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.886508 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.886513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:39.887296 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:39.887307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.888144 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.888147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:39.888277 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:39.888951 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:39.888972 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:39.890907 (+ 1935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:39.893790 (+ 2883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:39.893794 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:39.893797 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:39.894020 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:39.894400 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:39.894403 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:39.894405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:39.894503 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:39.895178 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:39.895182 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:39.895308 (+ 126us) client_negotiation.cc:769] Sending connection context
0807 15:22:39.895446 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 15:22:39.895615 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1063,"mutex_wait_us":2}
I20260807 15:22:39.897452 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.882063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46268 (local address 127.15.242.254:43479)
0807 15:22:39.882245 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:39.882253 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:39.883187 (+ 934us) server_negotiation.cc:407] Connection header received
0807 15:22:39.884515 (+ 1328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:39.884521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:39.884582 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:39.884660 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:39.885715 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.886619 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.887870 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.888337 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.888457 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:39.892115 (+ 3658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:39.892120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:39.892122 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:39.892151 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:39.895168 (+ 3017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:39.895792 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:39.895795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:39.895797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:39.895886 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:39.896265 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:39.896273 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:39.896278 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:39.896528 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:39.896595 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:39.897140 (+ 545us) server_negotiation.cc:299] Negotiation successful
0807 15:22:39.897276 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":51}
I20260807 15:22:39.897480 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.882346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:43479 (local address 127.0.0.1:46268)
0807 15:22:39.882983 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.883055 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:39.884188 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:39.884855 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:39.884861 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:39.885319 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:39.885547 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:39.885559 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.886753 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.886757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:39.887748 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:39.887757 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.888543 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.888549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:39.888649 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:39.889418 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:39.889445 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:39.891950 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:39.895292 (+ 3342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:39.895300 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:39.895306 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:39.895650 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:39.896019 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:39.896022 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:39.896026 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:39.896143 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:39.896683 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:39.896688 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:39.896867 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 15:22:39.897063 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 15:22:39.897276 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":2,"thread_start_us":150,"threads_started":1}
I20260807 15:22:39.897459 4487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.882346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47740 (local address 127.15.242.253:33209)
0807 15:22:39.883218 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:39.883233 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:39.883276 (+ 43us) server_negotiation.cc:407] Connection header received
0807 15:22:39.884166 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:39.884188 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:39.884409 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:39.884682 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:39.885274 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.886398 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.887424 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.888020 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.888230 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:39.891079 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:39.891086 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:39.891097 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:39.891122 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:39.893644 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:39.894144 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:39.894151 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:39.894158 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:39.894283 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:39.894604 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:39.894608 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:39.894610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:39.895047 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:39.895209 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:39.895687 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 15:22:39.896081 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":742,"spinlock_wait_cycles":61184,"thread_start_us":152,"threads_started":1}
I20260807 15:22:39.899473 4482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:22:39.900339 4367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:22:39.901262 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.900887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53526)
0807 15:22:39.901086 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.901155 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260807 15:22:39.902244 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.901904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53528)
0807 15:22:39.902099 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.902172 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260807 15:22:39.902477 4367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:36149: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Aug 07 15:22:39 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:22:39.910148 4487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.900080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47754 (local address 127.15.242.253:33209)
0807 15:22:39.900385 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:39.900391 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:39.900408 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:22:39.900450 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:39.900455 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:39.900505 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:39.900601 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:39.902422 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.903084 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.903971 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.904347 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.904444 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:39.906810 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:39.906813 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:39.906816 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:39.906851 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:39.908353 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:39.908803 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:39.908806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:39.908808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:39.908893 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:39.909249 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:39.909252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:39.909253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:39.909463 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:39.909566 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:39.909834 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 15:22:39.909977 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201}
I20260807 15:22:39.910182 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.900052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47754)
0807 15:22:39.900156 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.900172 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:39.900277 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:39.901925 (+ 1648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:39.901928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:39.902133 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:39.902269 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:39.902280 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.903221 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.903224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:39.903845 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:39.903855 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:39.904480 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:39.904483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:39.904607 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:39.905204 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:39.905217 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:39.906671 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:39.908504 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:39.908507 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:39.908509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:39.908699 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:39.908987 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:39.908991 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:39.908993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:39.909141 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:39.909555 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:39.909558 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:39.909646 (+ 88us) client_negotiation.cc:769] Sending connection context
0807 15:22:39.909802 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 15:22:39.910044 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":103}
I20260807 15:22:39.910992 4482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab.
Entry for principal kudu/127.15.242.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab.
I20260807 15:22:39.911883 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.911545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53538)
0807 15:22:39.911668 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.911817 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 15:22:39.912125 4408 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
I20260807 15:22:39.912868 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.252:36149
--webserver_interface=127.15.242.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab
--principal=kudu/127.15.242.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:43479,127.15.242.253:33209,127.15.242.252:36149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:22:39.915510 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.915265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53546)
0807 15:22:39.915394 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.915446 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 15:22:39.915737 4482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:36149: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
I20260807 15:22:39.933653 4367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } attempt: 1
I20260807 15:22:39.934633 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.934244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53560)
0807 15:22:39.934436 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.934524 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 15:22:39.935501 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.935266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53568)
0807 15:22:39.935381 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.935441 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 15:22:39.935657 4367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:36149: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
I20260807 15:22:39.965003 4482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } attempt: 1
I20260807 15:22:39.965935 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.965608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53572)
0807 15:22:39.965766 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.965845 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 15:22:39.966760 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:39.966528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53580)
0807 15:22:39.966643 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:39.966698 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 15:22:39.966881 4482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:36149: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
I20260807 15:22:40.010859 4367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } attempt: 2
I20260807 15:22:40.011853 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.011462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53584)
0807 15:22:40.011650 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.011746 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 15:22:40.012811 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.012490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53600)
0807 15:22:40.012618 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.012693 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 15:22:40.012977 4367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:36149: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
I20260807 15:22:40.035087 4482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } attempt: 2
I20260807 15:22:40.036159 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.035760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53614)
0807 15:22:40.035967 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.036048 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 15:22:40.037066 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.036746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53616)
0807 15:22:40.036923 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.036997 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260807 15:22:40.036850 4493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:40.037233 4493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:40.037246 4482 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:36149: Network error: Client connection negotiation failed: client connection to 127.15.242.252:36149: connect: Connection refused (error 111)
W20260807 15:22:40.037341 4493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:40.041862 4493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:40.041926 4493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:40.041947 4493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:40.041966 4493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:40.042021 4493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:40.047523 4493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:43479,127.15.242.253:33209,127.15.242.252:36149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab
--principal=kudu/127.15.242.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.252:36149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.242.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:40.048650 4493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:40.049738 4493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:40.058411 4502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:40.058487 4501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:40.058465 4504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:40.058646 4493 server_base.cc:1034] running on GCE node
I20260807 15:22:40.059269 4493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:40.060380 4493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:40.061553 4493 hybrid_clock.cc:648] HybridClock initialized: now 1786116160061536 us; error 28 us; skew 500 ppm
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116160, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:40.064383 4493 init.cc:377] Logged in from keytab as kudu/127.15.242.252@KRBTEST.COM (short username kudu)
I20260807 15:22:40.065340 4493 webserver.cc:460] Webserver started at http://127.15.242.252:45225/ using document root <none> and password file <none>
I20260807 15:22:40.065860 4493 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:40.065920 4493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:40.066087 4493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:22:40.068090 4493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/data/instance:
uuid: "415b11ff37c043ea961df950e9d17a84"
format_stamp: "Formatted at 2026-08-07 15:22:40 on dist-test-slave-g170"
server_key: "3a59dc4b425840a67037931cad6f8f6f"
server_key_iv: "aacffff834f6556c9907d072d392e173"
server_key_version: "encryptionkey@0"
I20260807 15:22:40.068610 4493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/wal/instance:
uuid: "415b11ff37c043ea961df950e9d17a84"
format_stamp: "Formatted at 2026-08-07 15:22:40 on dist-test-slave-g170"
server_key: "3a59dc4b425840a67037931cad6f8f6f"
server_key_iv: "aacffff834f6556c9907d072d392e173"
server_key_version: "encryptionkey@0"
I20260807 15:22:40.072444 4493 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 15:22:40.075001 4512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:40.076402 4493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:22:40.076511 4493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/wal
uuid: "415b11ff37c043ea961df950e9d17a84"
format_stamp: "Formatted at 2026-08-07 15:22:40 on dist-test-slave-g170"
server_key: "3a59dc4b425840a67037931cad6f8f6f"
server_key_iv: "aacffff834f6556c9907d072d392e173"
server_key_version: "encryptionkey@0"
I20260807 15:22:40.076598 4493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:40.100658 4493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:40.104218 4493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:40.104386 4493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:40.112210 4493 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.252:36149
I20260807 15:22:40.112138 4367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } attempt: 3
I20260807 15:22:40.112540 4584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.252:36149 every 8 connection(s)
I20260807 15:22:40.113374 4493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
I20260807 15:22:40.116418 4585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
I20260807 15:22:40.121173 4585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:22:40.121712 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 4493
I20260807 15:22:40.121858 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786115983990396-16331-0/minicluster-data/master-2/wal/instance
I20260807 15:22:40.122175 16331 external_mini_cluster.cc:1428] Setting key 1073f66168726a8c5a1db9368745a545
I20260807 15:22:40.125732 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.112618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53620)
0807 15:22:40.112852 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.112868 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:40.112963 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:40.115511 (+ 2548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:40.115515 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:40.115738 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:40.115871 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.115881 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.117424 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.117428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.118228 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.118244 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.118975 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.118980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.119089 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.119597 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:40.119615 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:40.121041 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:40.123584 (+ 2543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.123588 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.123590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.123875 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.124298 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.124301 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.124303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.124407 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.125209 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:40.125212 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:40.125310 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 15:22:40.125422 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 15:22:40.125556 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127}
I20260807 15:22:40.126827 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.113526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53620 (local address 127.15.242.252:36149)
0807 15:22:40.114013 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.114034 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.114084 (+ 50us) server_negotiation.cc:407] Connection header received
0807 15:22:40.114801 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.114819 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.115177 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.115565 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.116061 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.117284 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.118371 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.118847 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.118968 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.121249 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.121256 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.121273 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.121308 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.123451 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.124024 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.124031 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.124039 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.124204 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.124526 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.124529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.124530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.125073 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.125240 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.125583 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.125893 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":165,"threads_started":1}
I20260807 15:22:40.128455 4482 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } attempt: 3
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116160, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
I20260807 15:22:40.131994 4367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0: Bootstrap starting.
I20260807 15:22:40.134385 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.123566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46272 (local address 127.15.242.254:43479)
0807 15:22:40.123694 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.123698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.124051 (+ 353us) server_negotiation.cc:407] Connection header received
0807 15:22:40.124246 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.124249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.124307 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.124384 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.125133 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.125843 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.127235 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.127562 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.127662 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.130404 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.130408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.130411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.130436 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.132239 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.132812 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.132815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.132817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.132906 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.133238 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.133241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.133243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.133518 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.133599 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.134073 (+ 474us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.134201 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":62}
I20260807 15:22:40.135049 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.123461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:43479 (local address 127.0.0.1:46272)
0807 15:22:40.123932 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.123981 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:40.124144 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:40.124415 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:40.124421 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:40.124892 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:40.125013 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.125020 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.125972 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.125975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.127123 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.127132 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.127698 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.127705 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.127838 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.128324 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:40.128338 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:40.130188 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:40.132359 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.132369 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.132374 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.132695 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.133012 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.133018 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.133023 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.133121 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.133667 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:40.133673 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:40.133810 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 15:22:40.134588 (+ 778us) client_negotiation.cc:240] Negotiation successful
0807 15:22:40.134796 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":154,"thread_start_us":89,"threads_started":1}
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
I20260807 15:22:40.135248 4367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:40.136258 4367 log.cc:824] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:40.136333 4585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:22:40.136929 4591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.122864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53626 (local address 127.15.242.252:36149)
0807 15:22:40.123342 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.123353 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.123371 (+ 18us) server_negotiation.cc:407] Connection header received
0807 15:22:40.123539 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.123544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.123595 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.123675 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.124733 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.125495 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.126630 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.127043 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.127144 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.131560 (+ 4416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.131568 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.131571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.131595 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.133704 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.134194 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.134197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.134198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.134300 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.134880 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.134883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.134885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.135439 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.135620 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.136568 (+ 948us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.136696 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":387,"thread_start_us":152,"threads_started":1}
I20260807 15:22:40.139101 4367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0: No bootstrap required, opened a new log
I20260807 15:22:40.139389 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.128971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53630)
0807 15:22:40.129257 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.129271 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:40.129355 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:40.129573 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:40.129576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:40.129792 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:40.129904 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.129913 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.131235 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.131241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.132910 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.132921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.133515 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.133519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.133617 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.134100 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:40.134114 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:40.135548 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:40.137758 (+ 2210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.137761 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.137763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.138015 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.138355 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.138359 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.138361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.138459 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.138897 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:40.138900 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:40.138990 (+ 90us) client_negotiation.cc:769] Sending connection context
0807 15:22:40.139081 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 15:22:40.139225 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204}
I20260807 15:22:40.140025 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.129270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53630 (local address 127.15.242.252:36149)
0807 15:22:40.129369 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.129373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.129388 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:22:40.129427 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.129431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.129465 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.129555 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.130044 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.131093 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.133060 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.133379 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.135684 (+ 2305us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.135805 (+ 121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.135808 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.135810 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.135826 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.137629 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.138144 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.138147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.138149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.138235 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.138578 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.138581 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.138583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.138790 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.139678 (+ 888us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.139766 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.139870 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116160, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:22:40.143267 4367 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
I20260807 15:22:40.143512 4367 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:40.143519 4482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76: Bootstrap starting.
I20260807 15:22:40.143570 4367 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42e3fa43c0a7487b917de0f6ff0f79d0, State: Initialized, Role: FOLLOWER
I20260807 15:22:40.144158 4367 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
I20260807 15:22:40.144834 4598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.145074 4598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:22:40.146606 4367 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:22:40.146817 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.136902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:33209 (local address 127.0.0.1:47762)
0807 15:22:40.137252 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.137268 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:40.137401 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:40.137775 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:40.137778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:40.137950 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:40.138078 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.138088 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.139114 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.139117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.139916 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.139926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.140585 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.140590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.140683 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.141241 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:40.141256 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:40.142821 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:40.145054 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.145057 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.145059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.145336 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.145653 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.145656 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.145658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.145747 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.146282 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:40.146285 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:40.146385 (+ 100us) client_negotiation.cc:769] Sending connection context
0807 15:22:40.146488 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 15:22:40.146643 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":101,"threads_started":1}
I20260807 15:22:40.146811 4482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:40.147387 4487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.136964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47762 (local address 127.15.242.253:33209)
0807 15:22:40.137100 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.137105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.137331 (+ 226us) server_negotiation.cc:407] Connection header received
0807 15:22:40.137516 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.137520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.137572 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.137626 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.138211 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.138982 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.140043 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.140365 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.140475 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.142977 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.142981 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.142984 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.143010 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.144908 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.145449 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.145454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.145456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.145547 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.145854 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.145857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.145859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.146124 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.146222 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.147095 (+ 873us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.147220 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:22:40.147809 4482 log.cc:824] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:40.148126 4585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:22:40.150954 4482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76: No bootstrap required, opened a new log
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116160, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
W20260807 15:22:40.156049 4617 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:22:40.156139 4617 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:22:40.157613 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.144951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46274 (local address 127.15.242.254:43479)
0807 15:22:40.145108 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.145115 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.145129 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:22:40.145173 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.145176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.145225 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.145316 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.146192 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.146919 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.148675 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.149059 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.149167 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.152331 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.152336 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.152340 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.152368 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.155630 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.156175 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.156178 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.156180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.156270 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.156564 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.156571 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.156573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.156875 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.157049 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.157284 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.157419 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:22:40.157639 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.148690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:36149 (local address 127.0.0.1:53646)
0807 15:22:40.148961 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:40.148974 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:40.149060 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:40.149295 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:40.149298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:40.149456 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:40.149540 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.149546 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.150513 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.150518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.151425 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:40.151441 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.152006 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.152011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:40.152107 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.152560 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:40.152574 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:40.154068 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:40.155944 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.155946 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.155948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.156291 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.156585 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:40.156588 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:40.156589 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:40.156680 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:40.157140 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:40.157144 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:40.157251 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 15:22:40.157352 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 15:22:40.157478 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260807 15:22:40.158120 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.148948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53646 (local address 127.15.242.252:36149)
0807 15:22:40.149069 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.149073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.149089 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:22:40.149134 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.149139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.149179 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.149259 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.149667 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.150384 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.151565 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.151874 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.151982 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.154213 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.154216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.154219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.154241 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.155831 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.156393 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.156397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.156399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.156479 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.156809 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.156812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.156814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.157033 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.157129 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.157873 (+ 744us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.157972 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 15:22:40.155997 4269 master_runner.cc:186] Error getting master registration for 127.15.242.253:33209: OK, instance_id { permanent_uuid: "8a8955822b31432590c3829a8081ef76" instance_seqno: 1786116159869677 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 15:22:40.160303 4269 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 15:22:40.161258 4585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84: Bootstrap starting.
I20260807 15:22:40.161653 4482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
I20260807 15:22:40.161885 4482 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:40.161955 4482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a8955822b31432590c3829a8081ef76, State: Initialized, Role: FOLLOWER
I20260807 15:22:40.162479 4482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
I20260807 15:22:40.164079 4585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:40.164162 4482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [sys.catalog]: configured and running, proceeding with master startup.
Aug 07 15:22:40 dist-test-slave-g170 krb5kdc[4245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:22:40.165026 4585 log.cc:824] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:40.167348 4585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84: No bootstrap required, opened a new log
I20260807 15:22:40.167376 4622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.167511 4622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:22:40.171250 4585 raft_consensus.cc:348] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
I20260807 15:22:40.171505 4585 raft_consensus.cc:374] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:40.171571 4585 raft_consensus.cc:729] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b11ff37c043ea961df950e9d17a84, State: Initialized, Role: FOLLOWER
I20260807 15:22:40.172096 4585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
W20260807 15:22:40.172192 4642 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:22:40.172266 4642 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:22:40.173467 4585 sys_catalog.cc:564] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:22:40.172319 4376 master_runner.cc:186] Error getting master registration for 127.15.242.252:36149: OK, instance_id { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" instance_seqno: 1786116160110130 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 15:22:40.176460 4376 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 15:22:40.179185 4487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.159221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47770 (local address 127.15.242.253:33209)
0807 15:22:40.159366 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.159369 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.159512 (+ 143us) server_negotiation.cc:407] Connection header received
0807 15:22:40.159640 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.159643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.159685 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.159779 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.160444 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.161071 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.162124 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.162478 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.162579 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.165583 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.165587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.165591 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.165620 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.176718 (+ 11098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.177349 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.177353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.177355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.177449 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.177756 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.177759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.177761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.177992 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.178173 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.178899 (+ 726us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.179023 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 15:22:40.182130 4493 master_runner.cc:263] No leader master found from master 415b11ff37c043ea961df950e9d17a84
I20260807 15:22:40.182202 4493 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 15:22:40.182957 4661 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:22:40.183041 4661 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:22:40.184921 4645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.185055 4645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:22:40.185111 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:22:40.199470 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.187464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46276 (local address 127.15.242.254:43479)
0807 15:22:40.187588 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.187593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.188118 (+ 525us) server_negotiation.cc:407] Connection header received
0807 15:22:40.188309 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.188313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.188363 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.188419 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.189495 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.190290 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.191505 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.191861 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.191938 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.194860 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.194867 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.194870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.194897 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.197397 (+ 2500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.197917 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.197921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.197923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.198011 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.198352 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.198356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.198358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.198587 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.198706 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.199170 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.199299 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 15:22:40.204702 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.187481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53660 (local address 127.15.242.252:36149)
0807 15:22:40.187588 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.187593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.192607 (+ 5014us) server_negotiation.cc:407] Connection header received
0807 15:22:40.193878 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.193882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.193935 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.193987 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.195240 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.196008 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.198627 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.198963 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.199041 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.201112 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.201116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.201119 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.201147 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.202845 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.203361 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.203365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.203366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.203453 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.203743 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.203746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.203748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.203959 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.204070 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.204425 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.204542 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 15:22:40.210917 4487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:40.187901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47774 (local address 127.15.242.253:33209)
0807 15:22:40.188003 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:40.188007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:40.201218 (+ 13211us) server_negotiation.cc:407] Connection header received
0807 15:22:40.201405 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:40.201410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:40.201468 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:40.201521 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:40.202288 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.203070 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.204167 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:40.204498 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:40.204572 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:40.207243 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:40.207247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:40.207250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:40.207278 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:40.208886 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.209476 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.209480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.209482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.209568 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:40.209864 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:40.209867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:40.209869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:40.210067 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:40.210186 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:40.210630 (+ 444us) server_negotiation.cc:299] Negotiation successful
0807 15:22:40.210759 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 15:22:40.290732 4598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:22:40.290943 4598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
I20260807 15:22:40.292034 4598 leader_election.cc:288] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a8955822b31432590c3829a8081ef76 (127.15.242.253:33209), 415b11ff37c043ea961df950e9d17a84 (127.15.242.252:36149)
I20260807 15:22:40.292774 4544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b11ff37c043ea961df950e9d17a84" is_pre_election: true
I20260807 15:22:40.293128 4544 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42e3fa43c0a7487b917de0f6ff0f79d0 in term 0.
I20260807 15:22:40.293612 4297 leader_election.cc:302] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 415b11ff37c043ea961df950e9d17a84, 42e3fa43c0a7487b917de0f6ff0f79d0; no voters:
I20260807 15:22:40.293922 4598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:22:40.294014 4598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:22:40.294071 4598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:40.295464 4598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
I20260807 15:22:40.295807 4598 leader_election.cc:288] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [CANDIDATE]: Term 1 election: Requested vote from peers 8a8955822b31432590c3829a8081ef76 (127.15.242.253:33209), 415b11ff37c043ea961df950e9d17a84 (127.15.242.252:36149)
I20260807 15:22:40.296273 4544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b11ff37c043ea961df950e9d17a84"
I20260807 15:22:40.296399 4544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:40.297753 4544 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42e3fa43c0a7487b917de0f6ff0f79d0 in term 1.
I20260807 15:22:40.298079 4297 leader_election.cc:302] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 415b11ff37c043ea961df950e9d17a84, 42e3fa43c0a7487b917de0f6ff0f79d0; no voters:
I20260807 15:22:40.299086 4443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a8955822b31432590c3829a8081ef76"
I20260807 15:22:40.299255 4444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a8955822b31432590c3829a8081ef76" is_pre_election: true
I20260807 15:22:40.299363 4443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:40.300304 4598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:22:40.300583 4598 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [term 1 LEADER]: Becoming Leader. State: Replica: 42e3fa43c0a7487b917de0f6ff0f79d0, State: Running, Role: LEADER
I20260807 15:22:40.300709 4443 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42e3fa43c0a7487b917de0f6ff0f79d0 in term 1.
I20260807 15:22:40.300954 4598 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } }
I20260807 15:22:40.303004 4598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42e3fa43c0a7487b917de0f6ff0f79d0. Latest consensus state: current_term: 1 leader_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.303119 4598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:40.304976 4677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:22:40.305995 4677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:22:40.312109 4544 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [term 1 FOLLOWER]: Refusing update from remote peer 42e3fa43c0a7487b917de0f6ff0f79d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:22:40.312846 4673 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:22:40.317139 4645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42e3fa43c0a7487b917de0f6ff0f79d0. Latest consensus state: current_term: 1 leader_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.317288 4645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:22:40.321168 4443 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [term 1 FOLLOWER]: Refusing update from remote peer 42e3fa43c0a7487b917de0f6ff0f79d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:22:40.321800 4673 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:22:40.325917 4622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42e3fa43c0a7487b917de0f6ff0f79d0. Latest consensus state: current_term: 1 leader_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.326056 4622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:22:40.330340 4673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.330506 4673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:40.331372 4598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.331503 4598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:40.332934 4645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.333076 4645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:22:40.336386 4622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42e3fa43c0a7487b917de0f6ff0f79d0" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43479 } } peers { permanent_uuid: "8a8955822b31432590c3829a8081ef76" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 33209 } } peers { permanent_uuid: "415b11ff37c043ea961df950e9d17a84" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 36149 } } }
I20260807 15:22:40.336525 4622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:22:40.337730 4678 mvcc.cc:205] Tried to move back new op lower bound from 7315931792630050816 to 7315931792596033536. Current Snapshot: MvccSnapshot[applied={T|T < 7315931792630050816}]
I20260807 15:22:40.337931 4679 mvcc.cc:205] Tried to move back new op lower bound from 7315931792630050816 to 7315931792596033536. Current Snapshot: MvccSnapshot[applied={T|T < 7315931792630050816}]
I20260807 15:22:40.339270 4681 mvcc.cc:205] Tried to move back new op lower bound from 7315931792630050816 to 7315931792596033536. Current Snapshot: MvccSnapshot[applied={T|T < 7315931792630050816}]
I20260807 15:22:40.341256 4677 catalog_manager.cc:1347] Generated new cluster ID: 1c946b587ff045409e1fd4a9f5872535
I20260807 15:22:40.341332 4677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:22:40.373936 4677 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:22:40.375512 4677 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:22:40.388463 4677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42e3fa43c0a7487b917de0f6ff0f79d0: Generated new TSK 0
I20260807 15:22:40.389431 4677 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:22:41.173763 4642 catalog_manager.cc:1259] Loaded cluster ID: 1c946b587ff045409e1fd4a9f5872535
I20260807 15:22:41.173851 4642 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76: loading cluster ID for follower catalog manager: success
I20260807 15:22:41.175786 4642 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76: acquiring CA information for follower catalog manager: success
I20260807 15:22:41.176924 4642 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8a8955822b31432590c3829a8081ef76: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 15:22:41.184177 4661 catalog_manager.cc:1259] Loaded cluster ID: 1c946b587ff045409e1fd4a9f5872535
I20260807 15:22:41.184242 4661 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84: loading cluster ID for follower catalog manager: success
I20260807 15:22:41.185984 4661 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84: acquiring CA information for follower catalog manager: success
I20260807 15:22:41.187202 4661 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 415b11ff37c043ea961df950e9d17a84: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 15:22:41.449397 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 4269
I20260807 15:22:41.465492 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 4376
I20260807 15:22:41.477973 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 4493
2026-08-07T15:22:41Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3460 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:22:41 dist-test-slave-g170 krb5kdc[4701](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:22:41 dist-test-slave-g170 krb5kdc[4701](info): set up 2 sockets
Aug 07 15:22:41 dist-test-slave-g170 krb5kdc[4701](info): commencing operation
krb5kdc: starting...
W20260807 15:22:42.783737 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:22:42 dist-test-slave-g170 krb5kdc[4701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:22:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:22:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:22:42.923995 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:42095
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:34335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:42095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:43.042632 4717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:43.042965 4717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:43.043051 4717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:43.047111 4717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:43.047215 4717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:43.047255 4717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:43.047315 4717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:43.047350 4717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:43.052732 4717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:34335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:42095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:42095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:43.053874 4717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:43.054934 4717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:22:43.064353 4717 server_base.cc:1034] running on GCE node
W20260807 15:22:43.064237 4732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:43.064237 4726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:43.064265 4727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:43.065286 4717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:43.066365 4717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:43.067552 4717 hybrid_clock.cc:648] HybridClock initialized: now 1786116163067523 us; error 45 us; skew 500 ppm
Aug 07 15:22:43 dist-test-slave-g170 krb5kdc[4701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116163, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:43.076232 4717 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:22:43.077270 4717 webserver.cc:460] Webserver started at http://127.15.242.254:34405/ using document root <none> and password file <none>
I20260807 15:22:43.077850 4717 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:43.077917 4717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:43.078100 4717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:22:43.080336 4717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "dd524f8cb4654205a1b5798ff98238eb"
format_stamp: "Formatted at 2026-08-07 15:22:43 on dist-test-slave-g170"
server_key: "a81eac6b1313f37f0ce312c12d01d2d8"
server_key_iv: "162a141db28811b430681a288f7733e2"
server_key_version: "encryptionkey@0"
I20260807 15:22:43.080983 4717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "dd524f8cb4654205a1b5798ff98238eb"
format_stamp: "Formatted at 2026-08-07 15:22:43 on dist-test-slave-g170"
server_key: "a81eac6b1313f37f0ce312c12d01d2d8"
server_key_iv: "162a141db28811b430681a288f7733e2"
server_key_version: "encryptionkey@0"
I20260807 15:22:43.085076 4717 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:22:43.087677 4744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:43.089017 4717 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:22:43.089160 4717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "dd524f8cb4654205a1b5798ff98238eb"
format_stamp: "Formatted at 2026-08-07 15:22:43 on dist-test-slave-g170"
server_key: "a81eac6b1313f37f0ce312c12d01d2d8"
server_key_iv: "162a141db28811b430681a288f7733e2"
server_key_version: "encryptionkey@0"
I20260807 15:22:43.089287 4717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:43.110253 4717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:43.114193 4717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:43.114418 4717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:43.122700 4717 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:42095
I20260807 15:22:43.122761 4819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:42095 every 8 connection(s)
I20260807 15:22:43.123802 4717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:22:43.126827 4820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:43.132184 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 4717
I20260807 15:22:43.132355 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:22:43.132642 16331 external_mini_cluster.cc:1428] Setting key 823486413939d95526c938eb072bf8f2
I20260807 15:22:43.132730 4820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb: Bootstrap starting.
I20260807 15:22:43.135440 4820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:43.136348 4820 log.cc:824] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:43.138751 4820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb: No bootstrap required, opened a new log
Aug 07 15:22:43 dist-test-slave-g170 krb5kdc[4701](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:43.143297 4820 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd524f8cb4654205a1b5798ff98238eb" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42095 } }
I20260807 15:22:43.143615 4820 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:43.143687 4820 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd524f8cb4654205a1b5798ff98238eb, State: Initialized, Role: FOLLOWER
I20260807 15:22:43.144256 4820 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd524f8cb4654205a1b5798ff98238eb" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42095 } }
I20260807 15:22:43.144438 4820 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:22:43.144531 4820 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:22:43.144695 4820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:43.145922 4820 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd524f8cb4654205a1b5798ff98238eb" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42095 } }
I20260807 15:22:43.146313 4820 leader_election.cc:302] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd524f8cb4654205a1b5798ff98238eb; no voters:
I20260807 15:22:43.146772 4820 leader_election.cc:288] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:22:43.146930 4825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:22:43.147197 4825 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [term 1 LEADER]: Becoming Leader. State: Replica: dd524f8cb4654205a1b5798ff98238eb, State: Running, Role: LEADER
I20260807 15:22:43.147631 4825 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd524f8cb4654205a1b5798ff98238eb" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42095 } }
I20260807 15:22:43.148207 4820 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:22:43.149621 4826 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd524f8cb4654205a1b5798ff98238eb. Latest consensus state: current_term: 1 leader_uuid: "dd524f8cb4654205a1b5798ff98238eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd524f8cb4654205a1b5798ff98238eb" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42095 } } }
I20260807 15:22:43.149770 4823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:43.134041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40200 (local address 127.15.242.254:42095)
0807 15:22:43.134490 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:43.134507 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:43.134546 (+ 39us) server_negotiation.cc:407] Connection header received
0807 15:22:43.135233 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:43.135252 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:43.135668 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:43.135982 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:43.136977 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:43.138195 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:43.139431 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:43.139965 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:43.140106 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:43.143353 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:43.143361 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:43.143378 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:43.143422 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:43.145605 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:43.146112 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:43.146118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:43.146124 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:43.146269 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:43.146661 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:43.146666 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:43.146670 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:43.147240 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:43.147449 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:43.148167 (+ 718us) server_negotiation.cc:299] Negotiation successful
0807 15:22:43.148575 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":140,"threads_started":1}
I20260807 15:22:43.149916 4827 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd524f8cb4654205a1b5798ff98238eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd524f8cb4654205a1b5798ff98238eb" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 42095 } } }
I20260807 15:22:43.149992 4827 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:43.149768 4826 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:43.153726 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 15:22:43.153919 4846 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:22:43.154018 4846 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:22:43.154100 4844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:22:43.155159 4844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:22:43.161484 4844 catalog_manager.cc:1347] Generated new cluster ID: c06c416a1fb74a648ef4982b12484f4c
I20260807 15:22:43.161561 4844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:22:43.176519 4844 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:22:43.177925 4844 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:22:43.185274 4844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd524f8cb4654205a1b5798ff98238eb: Generated new TSK 0
I20260807 15:22:43.186105 4844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:22:43.210480 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 4717
2026-08-07T15:22:43Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1729 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:22:43 dist-test-slave-g170 krb5kdc[4859](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:22:43 dist-test-slave-g170 krb5kdc[4859](info): set up 2 sockets
Aug 07 15:22:43 dist-test-slave-g170 krb5kdc[4859](info): commencing operation
krb5kdc: starting...
W20260807 15:22:44.527882 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:22:44 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:22:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:22:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:22:44.667945 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38459
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:44.787266 4884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:44.787566 4884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:44.787637 4884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:44.791693 4884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:44.791787 4884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:44.791826 4884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:44.791894 4884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:44.791949 4884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:44.797309 4884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:44.798425 4884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:44.799487 4884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:44.808048 4892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:44.808022 4896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:44.808060 4891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:44.808176 4884 server_base.cc:1034] running on GCE node
I20260807 15:22:44.809002 4884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:44.810104 4884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:44.811302 4884 hybrid_clock.cc:648] HybridClock initialized: now 1786116164811274 us; error 41 us; skew 500 ppm
Aug 07 15:22:44 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116164, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:44.814709 4884 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:22:44.815696 4884 webserver.cc:460] Webserver started at http://127.15.242.254:38863/ using document root <none> and password file <none>
I20260807 15:22:44.816241 4884 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:44.816303 4884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:44.816473 4884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:22:44.818612 4884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "228367c6cb554c0da67490eed17a82a7"
format_stamp: "Formatted at 2026-08-07 15:22:44 on dist-test-slave-g170"
server_key: "a15e9b4f5ffa6cf816d32774ed68cb37"
server_key_iv: "ae203e3c1fe6523fe262d82c70fce72a"
server_key_version: "encryptionkey@0"
I20260807 15:22:44.819172 4884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "228367c6cb554c0da67490eed17a82a7"
format_stamp: "Formatted at 2026-08-07 15:22:44 on dist-test-slave-g170"
server_key: "a15e9b4f5ffa6cf816d32774ed68cb37"
server_key_iv: "ae203e3c1fe6523fe262d82c70fce72a"
server_key_version: "encryptionkey@0"
I20260807 15:22:44.823187 4884 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:22:44.825703 4910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:44.827096 4884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 15:22:44.827219 4884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "228367c6cb554c0da67490eed17a82a7"
format_stamp: "Formatted at 2026-08-07 15:22:44 on dist-test-slave-g170"
server_key: "a15e9b4f5ffa6cf816d32774ed68cb37"
server_key_iv: "ae203e3c1fe6523fe262d82c70fce72a"
server_key_version: "encryptionkey@0"
I20260807 15:22:44.827306 4884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:44.849110 4884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:44.852659 4884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:44.852910 4884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:44.860823 4884 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38459
I20260807 15:22:44.860852 4987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38459 every 8 connection(s)
I20260807 15:22:44.861829 4884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:22:44.864711 4989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:44.866267 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 4884
I20260807 15:22:44.866411 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:22:44.866779 16331 external_mini_cluster.cc:1428] Setting key 8b74b16575d046d23cf90d5ec742e11d
I20260807 15:22:44.871831 4989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Bootstrap starting.
I20260807 15:22:44.874552 4989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:44.875615 4989 log.cc:824] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Log is configured to *not* fsync() on all Append() calls
Aug 07 15:22:44 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:44.877767 4989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: No bootstrap required, opened a new log
I20260807 15:22:44.881311 4989 raft_consensus.cc:348] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:44.881585 4989 raft_consensus.cc:374] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:44.881685 4989 raft_consensus.cc:729] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 228367c6cb554c0da67490eed17a82a7, State: Initialized, Role: FOLLOWER
I20260807 15:22:44.882143 4989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:44.882262 4989 raft_consensus.cc:388] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:22:44.882346 4989 raft_consensus.cc:482] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:22:44.882481 4989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:44.882488 4994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:44.868452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50124 (local address 127.15.242.254:38459)
0807 15:22:44.868915 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:44.868934 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:44.868980 (+ 46us) server_negotiation.cc:407] Connection header received
0807 15:22:44.869611 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:44.869629 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:44.869964 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:44.870244 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:44.871206 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:44.872303 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:44.873510 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:44.874014 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:44.874135 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:44.877372 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:44.877378 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:44.877391 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:44.877418 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:44.879232 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:44.879709 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:44.879714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:44.879719 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:44.879827 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:44.880134 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:44.880138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:44.880139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:44.880537 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:44.880759 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:44.881137 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 15:22:44.881437 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":136,"threads_started":1}
I20260807 15:22:44.883387 4989 raft_consensus.cc:504] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:44.883770 4989 leader_election.cc:302] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 228367c6cb554c0da67490eed17a82a7; no voters:
I20260807 15:22:44.884130 4989 leader_election.cc:288] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:22:44.884279 4999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:22:44.884526 4999 raft_consensus.cc:686] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 1 LEADER]: Becoming Leader. State: Replica: 228367c6cb554c0da67490eed17a82a7, State: Running, Role: LEADER
I20260807 15:22:44.884891 4999 consensus_queue.cc:237] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:44.885468 4989 sys_catalog.cc:564] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:22:44.886102 5000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 228367c6cb554c0da67490eed17a82a7. Latest consensus state: current_term: 1 leader_uuid: "228367c6cb554c0da67490eed17a82a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } } }
I20260807 15:22:44.886299 5000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:44.886590 5001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "228367c6cb554c0da67490eed17a82a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } } }
I20260807 15:22:44.886708 5001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:44.886909 5013 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:22:44.890094 5013 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:22:44.895951 5013 catalog_manager.cc:1347] Generated new cluster ID: a41f8532407b4aaa9a6c0307d4179c93
I20260807 15:22:44.896041 5013 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:22:44.905858 5013 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:22:44.906857 5013 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:22:44.913371 5013 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Generated new TSK 0
I20260807 15:22:44.914253 5013 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:22:44.953779 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38459
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:45.087110 5033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:45.087386 5033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:45.087430 5033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:45.091485 5033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:45.091558 5033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:45.091624 5033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:22:45.096896 5033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:45.098011 5033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:45.099117 5033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:45.108836 5042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:45.108834 5041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:45.109011 5046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:45.109910 5033 server_base.cc:1034] running on GCE node
I20260807 15:22:45.110390 5033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:45.111056 5033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:45.112231 5033 hybrid_clock.cc:648] HybridClock initialized: now 1786116165112196 us; error 43 us; skew 500 ppm
Aug 07 15:22:45 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116165, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:45.115427 5033 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:22:45.116430 5033 webserver.cc:460] Webserver started at http://127.15.242.193:42975/ using document root <none> and password file <none>
I20260807 15:22:45.117105 5033 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:45.117174 5033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:45.117358 5033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:22:45.119607 5033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "b275f72c70aa43c89058510dc4ff461d"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "4db3ebd7575bff4c1ead429c55ef87ae"
server_key_iv: "cf0316c2b4fda2464fe764495b7fe18c"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.120160 5033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "b275f72c70aa43c89058510dc4ff461d"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "4db3ebd7575bff4c1ead429c55ef87ae"
server_key_iv: "cf0316c2b4fda2464fe764495b7fe18c"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.124734 5033 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260807 15:22:45.127975 5059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.129570 5033 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:22:45.129738 5033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "b275f72c70aa43c89058510dc4ff461d"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "4db3ebd7575bff4c1ead429c55ef87ae"
server_key_iv: "cf0316c2b4fda2464fe764495b7fe18c"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.129920 5033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:45.142350 5033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:45.146003 5033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:45.146237 5033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:45.146955 5033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:45.147934 5033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:45.148011 5033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.148088 5033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:45.148136 5033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.158603 5033 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:37197
I20260807 15:22:45.158629 5232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:37197 every 8 connection(s)
I20260807 15:22:45.159850 5033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:22:45.162568 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 5033
I20260807 15:22:45.162813 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:22:45.163161 16331 external_mini_cluster.cc:1428] Setting key 6799c1fd7d71d566348768b67fc5ad84
Aug 07 15:22:45 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116165, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:22:45.177119 4994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.162182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:37539 (local address 127.15.242.254:38459)
0807 15:22:45.162399 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.162405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.163555 (+ 1150us) server_negotiation.cc:407] Connection header received
0807 15:22:45.165201 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.165207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.165269 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.165367 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:45.166811 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.167464 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.169143 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.169455 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.169613 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.172754 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:45.172758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:45.172803 (+ 45us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:45.172840 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:45.174554 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:45.175151 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:45.175160 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:45.175161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:45.175268 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:45.175751 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:45.175754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:45.175755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:45.175961 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:45.176059 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.176828 (+ 769us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.176983 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:22:45.178193 5237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.162650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:37539)
0807 15:22:45.163355 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.163418 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:45.164931 (+ 1513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:45.165508 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:45.165515 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:45.165896 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:45.166617 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.166638 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.167624 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.167630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.169008 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.169019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.169672 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.169677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.169943 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.170648 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:45.170667 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:45.172546 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:45.174693 (+ 2147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:45.174700 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:45.174727 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:45.175019 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:45.175421 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:45.175424 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:45.175425 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:45.175574 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:45.176090 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:45.176097 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:45.176447 (+ 350us) client_negotiation.cc:769] Sending connection context
0807 15:22:45.176640 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 15:22:45.177021 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":223,"threads_started":1}
I20260807 15:22:45.179837 5234 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38459
I20260807 15:22:45.180128 5234 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:45.180698 5234 heartbeater.cc:511] Master 127.15.242.254:38459 requested a full tablet report, sending...
I20260807 15:22:45.182312 4939 ts_manager.cc:194] Registered new tserver with Master: b275f72c70aa43c89058510dc4ff461d (127.15.242.193:37197)
I20260807 15:22:45.183487 4939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:37539
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:22:45.196348 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38459
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:45.316708 5240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:45.317046 5240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:45.317116 5240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:45.321203 5240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:45.321260 5240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:45.321336 5240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:22:45.326670 5240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:45.327751 5240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:45.328881 5240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:45.339184 5253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:45.339169 5256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:45.339169 5250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:45.339448 5240 server_base.cc:1034] running on GCE node
I20260807 15:22:45.340021 5240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:45.340724 5240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:45.341986 5240 hybrid_clock.cc:648] HybridClock initialized: now 1786116165341942 us; error 57 us; skew 500 ppm
Aug 07 15:22:45 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116165, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:45.345139 5240 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:22:45.346175 5240 webserver.cc:460] Webserver started at http://127.15.242.194:41613/ using document root <none> and password file <none>
I20260807 15:22:45.346800 5240 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:45.346907 5240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:45.347165 5240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:22:45.349457 5240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "1e8f867595c746c095627dadc82a5d6b"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "74fe3ee5feff861241bf5004255df407"
server_key_iv: "6e511ec21615e78a0365cc31955ebf45"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.350090 5240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "1e8f867595c746c095627dadc82a5d6b"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "74fe3ee5feff861241bf5004255df407"
server_key_iv: "6e511ec21615e78a0365cc31955ebf45"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.354242 5240 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:22:45.357064 5266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.358467 5240 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:22:45.358620 5240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "1e8f867595c746c095627dadc82a5d6b"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "74fe3ee5feff861241bf5004255df407"
server_key_iv: "6e511ec21615e78a0365cc31955ebf45"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.358744 5240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:45.381966 5240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:45.385537 5240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:45.385793 5240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:45.386515 5240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:45.387529 5240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:45.387596 5240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.387665 5240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:45.387706 5240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.397899 5240 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:41259
I20260807 15:22:45.397923 5472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:41259 every 8 connection(s)
I20260807 15:22:45.398893 5240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:22:45.404112 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 5240
I20260807 15:22:45.404280 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:22:45.404565 16331 external_mini_cluster.cc:1428] Setting key 5ed414cfd4d5ac386b957a2e0f77de2d
Aug 07 15:22:45 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116165, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:45.415880 4994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.400958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:42459 (local address 127.15.242.254:38459)
0807 15:22:45.401114 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.401117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.401955 (+ 838us) server_negotiation.cc:407] Connection header received
0807 15:22:45.403418 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.403422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.403481 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.403588 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:45.405008 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.405741 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.407483 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.407714 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.407800 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.411311 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:45.411314 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:45.411316 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:45.411340 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:45.413239 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:45.414023 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:45.414026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:45.414027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:45.414109 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:45.414596 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:45.414599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:45.414600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:45.414780 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:45.414857 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.415649 (+ 792us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.415756 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 15:22:45.417287 5475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.401334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:42459)
0807 15:22:45.401799 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.401844 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:45.403202 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:45.403771 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:45.403778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:45.404138 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:45.404866 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.404883 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.405881 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.405905 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.407334 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.407351 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.407890 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.407897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.408149 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.409010 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:45.409036 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:45.411086 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:45.413382 (+ 2296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:45.413394 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:45.413416 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:45.413870 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:45.414231 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:45.414237 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:45.414242 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:45.414479 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:45.414924 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:45.414933 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:45.415333 (+ 400us) client_negotiation.cc:769] Sending connection context
0807 15:22:45.415581 (+ 248us) client_negotiation.cc:240] Negotiation successful
0807 15:22:45.415982 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:22:45.418828 5473 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38459
I20260807 15:22:45.419075 5473 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:45.419728 5473 heartbeater.cc:511] Master 127.15.242.254:38459 requested a full tablet report, sending...
I20260807 15:22:45.420922 4939 ts_manager.cc:194] Registered new tserver with Master: 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:22:45.421674 4939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:42459
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:22:45.440014 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38459
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:45.562634 5481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:45.562989 5481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:45.563069 5481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:45.567073 5481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:45.567126 5481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:45.567225 5481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:22:45.572386 5481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:45.573525 5481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:45.574577 5481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:45.584460 5487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:45.584559 5481 server_base.cc:1034] running on GCE node
W20260807 15:22:45.584481 5488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:45.584530 5490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:45.585247 5481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:45.585978 5481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:45.587165 5481 hybrid_clock.cc:648] HybridClock initialized: now 1786116165587135 us; error 45 us; skew 500 ppm
Aug 07 15:22:45 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116165, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:45.590106 5481 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:22:45.591089 5481 webserver.cc:460] Webserver started at http://127.15.242.195:36165/ using document root <none> and password file <none>
I20260807 15:22:45.591768 5481 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:45.592036 5481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:45.592342 5481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:22:45.594688 5481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "7f8ed969d66a4d0f8338d7d4f99eeece"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "2aa811112ada2f5ea25b20e085f91145"
server_key_iv: "366df8344ae31c731dacc1271a8a0841"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.595400 5481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "7f8ed969d66a4d0f8338d7d4f99eeece"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "2aa811112ada2f5ea25b20e085f91145"
server_key_iv: "366df8344ae31c731dacc1271a8a0841"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.599841 5481 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:22:45.603010 5501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.604418 5481 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:22:45.604583 5481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "7f8ed969d66a4d0f8338d7d4f99eeece"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "2aa811112ada2f5ea25b20e085f91145"
server_key_iv: "366df8344ae31c731dacc1271a8a0841"
server_key_version: "encryptionkey@0"
I20260807 15:22:45.604727 5481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:45.617703 5481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:45.621197 5481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:45.621428 5481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:45.622048 5481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:45.622933 5481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:45.623016 5481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.623108 5481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:45.623145 5481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:45.634339 5481 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:44849
I20260807 15:22:45.634382 5690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:44849 every 8 connection(s)
I20260807 15:22:45.635298 5481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:22:45.637923 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 5481
I20260807 15:22:45.638080 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:22:45.638428 16331 external_mini_cluster.cc:1428] Setting key 00823b3b00f0057488710acaafd33b6f
Aug 07 15:22:45 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116165, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:45.650147 4994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.637238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:37773 (local address 127.15.242.254:38459)
0807 15:22:45.637427 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.637431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.638366 (+ 935us) server_negotiation.cc:407] Connection header received
0807 15:22:45.640039 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.640042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.640113 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.640193 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:45.641579 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.642110 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.643207 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.643439 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.643525 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.646411 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:45.646414 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:45.646416 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:45.646441 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:45.647846 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:45.648428 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:45.648432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:45.648433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:45.648523 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:45.648980 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:45.648984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:45.648985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:45.649206 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:45.649297 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.649902 (+ 605us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.650015 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 15:22:45.651033 5697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.637635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:37773)
0807 15:22:45.638173 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.638237 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:45.639815 (+ 1578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:45.640345 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:45.640352 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:45.640851 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:45.641434 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.641449 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.642231 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.642233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.643089 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.643098 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.643578 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.643580 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.643739 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.644364 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:45.644381 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:45.646229 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:45.647970 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:45.647976 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:45.647990 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:45.648304 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:45.648651 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:45.648653 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:45.648655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:45.648879 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:45.649348 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:45.649357 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:45.649611 (+ 254us) client_negotiation.cc:769] Sending connection context
0807 15:22:45.649786 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 15:22:45.650058 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":147,"threads_started":1}
I20260807 15:22:45.652457 5691 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38459
I20260807 15:22:45.652730 5691 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:45.653386 5691 heartbeater.cc:511] Master 127.15.242.254:38459 requested a full tablet report, sending...
I20260807 15:22:45.654444 4934 ts_manager.cc:194] Registered new tserver with Master: 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849)
I20260807 15:22:45.655092 4934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:37773
I20260807 15:22:45.665309 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:22:45.675192 4994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.667316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50138 (local address 127.15.242.254:38459)
0807 15:22:45.667467 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.667472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.667661 (+ 189us) server_negotiation.cc:407] Connection header received
0807 15:22:45.667828 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.667832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.667885 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.667971 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:45.668697 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.669309 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.670142 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.670364 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.670470 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.671961 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:45.671965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:45.671967 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:45.671992 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:45.673391 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:45.673862 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:45.673866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:45.673868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:45.673954 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:45.674265 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:45.674269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:45.674270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:45.674496 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:45.674723 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.674894 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.675022 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:22:45.678609 4934 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:22:45.681951 4934 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:22:45.697499 5711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.691139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:37197 (local address 127.0.0.1:48780)
0807 15:22:45.691467 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.691514 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:45.691649 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:45.693325 (+ 1676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:45.693328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:45.693346 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:45.693661 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.693672 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.694712 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.694718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.696013 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.696023 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.696890 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.696894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.697009 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.697048 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 15:22:45.697218 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 15:22:45.697348 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":170,"spinlock_wait_cycles":3840,"thread_start_us":100,"threads_started":1}
I20260807 15:22:45.697510 5714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.692182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48780 (local address 127.15.242.193:37197)
0807 15:22:45.692880 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.692887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.692907 (+ 20us) server_negotiation.cc:407] Connection header received
0807 15:22:45.692973 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.692977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.693159 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.693553 (+ 394us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:45.693806 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.694583 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.696145 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.696717 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.696911 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.697107 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.697257 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.697355 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":109,"threads_started":1}
I20260807 15:22:45.699004 5712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.691930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44849 (local address 127.0.0.1:42386)
0807 15:22:45.692501 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.692518 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:45.692611 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:45.693306 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:45.693313 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:45.693338 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:45.693661 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.693672 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.695301 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.695305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.696904 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.696918 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.698382 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.698387 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.698634 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.698682 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 15:22:45.698764 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 15:22:45.698857 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":180,"thread_start_us":95,"threads_started":1}
I20260807 15:22:45.699159 5713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.692025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50778 (local address 127.15.242.194:41259)
0807 15:22:45.692811 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.692825 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.692850 (+ 25us) server_negotiation.cc:407] Connection header received
0807 15:22:45.692938 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.692944 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.693160 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.693319 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:45.693872 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.695333 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.697077 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.698012 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.698161 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.698286 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.698855 (+ 569us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.698955 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":130,"threads_started":1}
I20260807 15:22:45.699527 5715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.692246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42386 (local address 127.15.242.195:44849)
0807 15:22:45.692855 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.692868 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.692899 (+ 31us) server_negotiation.cc:407] Connection header received
0807 15:22:45.692970 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.692974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.693139 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.693317 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:45.693855 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.695133 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.697077 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.698012 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.698151 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.698286 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.699278 (+ 992us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.699382 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":163,"threads_started":1}
I20260807 15:22:45.699513 5710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.691106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:41259 (local address 127.0.0.1:50778)
0807 15:22:45.691468 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.691517 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:45.691649 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:45.693498 (+ 1849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:45.693500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:45.693517 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:45.693753 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.693764 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.695512 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.695516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.696929 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.696937 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.698383 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.698387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.698630 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.698684 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 15:22:45.698764 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 15:22:45.699375 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":741,"spinlock_wait_cycles":2176,"thread_start_us":107,"threads_started":1}
I20260807 15:22:45.701074 5135 tablet_service.cc:1467] Processing CreateTablet for tablet c6d5433fa40144c0901957fbb284e3d0 (DEFAULT_TABLE table=test-table [id=003f59fed07f43998105e07d61a94d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:45.702082 5135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6d5433fa40144c0901957fbb284e3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:45.702601 5350 tablet_service.cc:1467] Processing CreateTablet for tablet c6d5433fa40144c0901957fbb284e3d0 (DEFAULT_TABLE table=test-table [id=003f59fed07f43998105e07d61a94d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:45.702837 5582 tablet_service.cc:1467] Processing CreateTablet for tablet c6d5433fa40144c0901957fbb284e3d0 (DEFAULT_TABLE table=test-table [id=003f59fed07f43998105e07d61a94d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:45.703691 5350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6d5433fa40144c0901957fbb284e3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:45.703730 5582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6d5433fa40144c0901957fbb284e3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:45.709097 5716 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Bootstrap starting.
I20260807 15:22:45.711321 5717 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: Bootstrap starting.
I20260807 15:22:45.711694 5716 tablet_bootstrap.cc:654] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:45.712744 5716 log.cc:824] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:45.713518 5718 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: Bootstrap starting.
I20260807 15:22:45.714100 5717 tablet_bootstrap.cc:654] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:45.714979 5716 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: No bootstrap required, opened a new log
I20260807 15:22:45.714962 5717 log.cc:824] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:45.715209 5716 ts_tablet_manager.cc:1397] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 15:22:45.715691 5718 tablet_bootstrap.cc:654] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:45.716743 5718 log.cc:824] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:45.718868 5717 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: No bootstrap required, opened a new log
I20260807 15:22:45.718873 5718 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: No bootstrap required, opened a new log
I20260807 15:22:45.719064 5717 ts_tablet_manager.cc:1397] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260807 15:22:45.719064 5718 ts_tablet_manager.cc:1397] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 15:22:45.719172 5716 raft_consensus.cc:348] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.719429 5716 raft_consensus.cc:374] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:45.719480 5716 raft_consensus.cc:729] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b275f72c70aa43c89058510dc4ff461d, State: Initialized, Role: FOLLOWER
I20260807 15:22:45.719967 5716 consensus_queue.cc:260] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.721004 5716 ts_tablet_manager.cc:1428] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 15:22:45.721398 5234 heartbeater.cc:503] Master 127.15.242.254:38459 was elected leader, sending a full tablet report...
I20260807 15:22:45.723130 5718 raft_consensus.cc:348] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.723130 5717 raft_consensus.cc:348] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.723408 5717 raft_consensus.cc:374] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:45.723408 5718 raft_consensus.cc:374] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:45.723464 5718 raft_consensus.cc:729] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f8ed969d66a4d0f8338d7d4f99eeece, State: Initialized, Role: FOLLOWER
I20260807 15:22:45.723464 5717 raft_consensus.cc:729] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8f867595c746c095627dadc82a5d6b, State: Initialized, Role: FOLLOWER
I20260807 15:22:45.723939 5717 consensus_queue.cc:260] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.723939 5718 consensus_queue.cc:260] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.724983 5718 ts_tablet_manager.cc:1428] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260807 15:22:45.724983 5717 ts_tablet_manager.cc:1428] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:22:45.725185 5691 heartbeater.cc:503] Master 127.15.242.254:38459 was elected leader, sending a full tablet report...
I20260807 15:22:45.725768 5473 heartbeater.cc:503] Master 127.15.242.254:38459 was elected leader, sending a full tablet report...
I20260807 15:22:45.797570 5724 raft_consensus.cc:482] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:22:45.797797 5724 raft_consensus.cc:504] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.798954 5724 leader_election.cc:288] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b275f72c70aa43c89058510dc4ff461d (127.15.242.193:37197), 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849)
I20260807 15:22:45.803202 5715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.799515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:39039 (local address 127.15.242.195:44849)
0807 15:22:45.799700 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.799706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.799721 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:22:45.799775 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.799777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.799816 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.799905 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:45.800217 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.800960 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.802153 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.802603 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.802699 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.802751 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.802988 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.803069 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 15:22:45.803205 5475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.799266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44849 (local address 127.15.242.194:39039)
0807 15:22:45.799445 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.799464 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:45.799608 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:45.799922 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:45.799925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:45.799945 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:45.800073 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.800082 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.801074 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.801077 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.802012 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.802023 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.802733 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.802737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.802853 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.802880 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 15:22:45.802952 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 15:22:45.803034 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":21}
I20260807 15:22:45.803352 5714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.799411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:43319 (local address 127.15.242.193:37197)
0807 15:22:45.799579 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.799585 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.800047 (+ 462us) server_negotiation.cc:407] Connection header received
0807 15:22:45.800156 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.800159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.800214 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.800281 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:45.800560 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.801205 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.802291 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.802771 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.802884 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.802950 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.803144 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.803225 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 15:22:45.803375 5727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.799266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:37197 (local address 127.15.242.194:43319)
0807 15:22:45.799949 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.799961 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:45.800069 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:45.800313 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:45.800316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:45.800334 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:45.800448 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.800454 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.801312 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.801315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.802155 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:45.802166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.802886 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.802889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:45.803008 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.803031 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 15:22:45.803106 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 15:22:45.803170 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":325,"thread_start_us":151,"threads_started":1}
I20260807 15:22:45.803992 5606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d5433fa40144c0901957fbb284e3d0" candidate_uuid: "1e8f867595c746c095627dadc82a5d6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" is_pre_election: true
I20260807 15:22:45.804211 5168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d5433fa40144c0901957fbb284e3d0" candidate_uuid: "1e8f867595c746c095627dadc82a5d6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b275f72c70aa43c89058510dc4ff461d" is_pre_election: true
I20260807 15:22:45.804379 5606 raft_consensus.cc:2454] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8f867595c746c095627dadc82a5d6b in term 0.
I20260807 15:22:45.804456 5168 raft_consensus.cc:2454] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8f867595c746c095627dadc82a5d6b in term 0.
I20260807 15:22:45.804944 5275 leader_election.cc:302] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1e8f867595c746c095627dadc82a5d6b, 7f8ed969d66a4d0f8338d7d4f99eeece, b275f72c70aa43c89058510dc4ff461d; no voters:
I20260807 15:22:45.805236 5724 raft_consensus.cc:2781] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:22:45.805333 5724 raft_consensus.cc:482] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:22:45.805429 5724 raft_consensus.cc:3037] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:45.806516 5724 raft_consensus.cc:504] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.806874 5724 leader_election.cc:288] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [CANDIDATE]: Term 1 election: Requested vote from peers b275f72c70aa43c89058510dc4ff461d (127.15.242.193:37197), 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849)
I20260807 15:22:45.807276 5606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d5433fa40144c0901957fbb284e3d0" candidate_uuid: "1e8f867595c746c095627dadc82a5d6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece"
I20260807 15:22:45.807385 5606 raft_consensus.cc:3037] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:45.808012 5168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6d5433fa40144c0901957fbb284e3d0" candidate_uuid: "1e8f867595c746c095627dadc82a5d6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b275f72c70aa43c89058510dc4ff461d"
I20260807 15:22:45.808146 5168 raft_consensus.cc:3037] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:45.808825 5606 raft_consensus.cc:2454] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8f867595c746c095627dadc82a5d6b in term 1.
I20260807 15:22:45.809217 5268 leader_election.cc:302] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8f867595c746c095627dadc82a5d6b, 7f8ed969d66a4d0f8338d7d4f99eeece; no voters:
I20260807 15:22:45.809407 5724 raft_consensus.cc:2781] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:22:45.809651 5724 raft_consensus.cc:686] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 1 LEADER]: Becoming Leader. State: Replica: 1e8f867595c746c095627dadc82a5d6b, State: Running, Role: LEADER
I20260807 15:22:45.809691 5168 raft_consensus.cc:2454] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8f867595c746c095627dadc82a5d6b in term 1.
I20260807 15:22:45.810030 5724 consensus_queue.cc:237] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:45.813360 4939 catalog_manager.cc:5495] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8f867595c746c095627dadc82a5d6b (127.15.242.194). New cstate: current_term: 1 leader_uuid: "1e8f867595c746c095627dadc82a5d6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260807 15:22:45.851285 5713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.847322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50788 (local address 127.15.242.194:41259)
0807 15:22:45.847470 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:45.847474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:45.847487 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:22:45.847574 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:45.847577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:45.847636 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:45.847741 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:22:45.848125 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.848642 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.849709 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:45.849930 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:45.850017 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:45.850348 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:22:45.850851 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:22:45.850950 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:45.851076 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 15:22:45.851137 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:22:45.858219 5606 raft_consensus.cc:1261] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 1 FOLLOWER]: Refusing update from remote peer 1e8f867595c746c095627dadc82a5d6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:22:45.858219 5168 raft_consensus.cc:1261] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Refusing update from remote peer 1e8f867595c746c095627dadc82a5d6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:22:45.859186 5724 consensus_queue.cc:1035] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:22:45.859416 5729 consensus_queue.cc:1035] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:22:45.875980 5739 mvcc.cc:205] Tried to move back new op lower bound from 7315931815346106368 to 7315931815160233984. Current Snapshot: MvccSnapshot[applied={T|T < 7315931815346106368}]
I20260807 15:22:45.882301 4939 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:22:45.882524 4939 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:22:45.885109 4939 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Sending DeleteTablet for 3 replicas of tablet c6d5433fa40144c0901957fbb284e3d0
I20260807 15:22:45.886018 5135 tablet_service.cc:1514] Processing DeleteTablet for tablet c6d5433fa40144c0901957fbb284e3d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:45 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:48780
I20260807 15:22:45.886267 5350 tablet_service.cc:1514] Processing DeleteTablet for tablet c6d5433fa40144c0901957fbb284e3d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:45 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:50778
I20260807 15:22:45.886741 5753 tablet_replica.cc:330] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: stopping tablet replica
I20260807 15:22:45.886829 5582 tablet_service.cc:1514] Processing DeleteTablet for tablet c6d5433fa40144c0901957fbb284e3d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:45 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:42386
I20260807 15:22:45.886984 5751 tablet_replica.cc:330] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: stopping tablet replica
I20260807 15:22:45.887034 5753 raft_consensus.cc:2229] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:22:45.887328 5751 raft_consensus.cc:2229] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:22:45.887408 5753 raft_consensus.cc:2258] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:22:45.887537 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 5033
I20260807 15:22:45.887647 5751 raft_consensus.cc:2258] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:22:45.889312 5753 ts_tablet_manager.cc:1905] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:22:45.892313 5753 ts_tablet_manager.cc:1918] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:22:45.892409 5753 log.cc:1196] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/c6d5433fa40144c0901957fbb284e3d0
I20260807 15:22:45.892750 5753 ts_tablet_manager.cc:1939] T c6d5433fa40144c0901957fbb284e3d0 P 1e8f867595c746c095627dadc82a5d6b: Deleting consensus metadata
I20260807 15:22:45.894071 4913 catalog_manager.cc:4841] TS 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259): tablet c6d5433fa40144c0901957fbb284e3d0 (table test-table [id=003f59fed07f43998105e07d61a94d9d]) successfully deleted
I20260807 15:22:45.897033 5755 tablet_replica.cc:330] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: stopping tablet replica
I20260807 15:22:45.897404 5755 raft_consensus.cc:2229] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:22:45.897748 5755 raft_consensus.cc:2258] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:22:45.899305 5755 ts_tablet_manager.cc:1905] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:22:45.902182 5755 ts_tablet_manager.cc:1918] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:22:45.902285 5755 log.cc:1196] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/c6d5433fa40144c0901957fbb284e3d0
I20260807 15:22:45.902632 5755 ts_tablet_manager.cc:1939] T c6d5433fa40144c0901957fbb284e3d0 P 7f8ed969d66a4d0f8338d7d4f99eeece: Deleting consensus metadata
I20260807 15:22:45.904036 4913 catalog_manager.cc:4841] TS 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849): tablet c6d5433fa40144c0901957fbb284e3d0 (table test-table [id=003f59fed07f43998105e07d61a94d9d]) successfully deleted
I20260807 15:22:45.913898 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 5240
W20260807 15:22:45.914004 4916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:37197 (error 108)
I20260807 15:22:45.919293 5710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:45.918875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:37197 (local address 127.0.0.1:48792)
0807 15:22:45.919067 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:45.919164 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:37197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 15:22:45.919541 4916 catalog_manager.cc:4584] TS b275f72c70aa43c89058510dc4ff461d (127.15.242.193:37197): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c6d5433fa40144c0901957fbb284e3d0: Network error: Client connection negotiation failed: client connection to 127.15.242.193:37197: connect: Connection refused (error 111)
I20260807 15:22:45.925179 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 5481
I20260807 15:22:45.942832 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 4884
I20260807 15:22:45.959964 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38459
--webserver_interface=127.15.242.254
--webserver_port=38863
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:46.081619 5757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:46.081986 5757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:46.082074 5757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:46.086251 5757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:46.086344 5757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:46.086380 5757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:46.086418 5757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:46.086460 5757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:46.091900 5757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=38863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:46.093145 5757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:46.094273 5757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:46.109830 5768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:46.109827 5764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:46.109887 5766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:46.110280 5757 server_base.cc:1034] running on GCE node
I20260807 15:22:46.110965 5757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:46.112166 5757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:46.113368 5757 hybrid_clock.cc:648] HybridClock initialized: now 1786116166113347 us; error 32 us; skew 500 ppm
Aug 07 15:22:46 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116166, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:46.116355 5757 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:22:46.117604 5757 webserver.cc:460] Webserver started at http://127.15.242.254:38863/ using document root <none> and password file <none>
I20260807 15:22:46.118279 5757 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:46.118428 5757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:46.122918 5757 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 15:22:46.125674 5780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:46.127043 5757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:22:46.127372 5757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "228367c6cb554c0da67490eed17a82a7"
format_stamp: "Formatted at 2026-08-07 15:22:44 on dist-test-slave-g170"
server_key: "a15e9b4f5ffa6cf816d32774ed68cb37"
server_key_iv: "ae203e3c1fe6523fe262d82c70fce72a"
server_key_version: "encryptionkey@0"
I20260807 15:22:46.128095 5757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:46.143697 5757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:46.147212 5757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:46.147442 5757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:46.155419 5757 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38459
I20260807 15:22:46.155787 5861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38459 every 8 connection(s)
I20260807 15:22:46.156653 5757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:22:46.158015 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 5757
I20260807 15:22:46.158521 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:37197
--local_ip_for_outbound_sockets=127.15.242.193
--tserver_master_addrs=127.15.242.254:38459
--webserver_port=42975
--webserver_interface=127.15.242.193
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:22:46.161500 5863 sys_catalog.cc:263] Verifying existing consensus state
I20260807 15:22:46.163246 5863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Bootstrap starting.
I20260807 15:22:46.181725 5863 log.cc:824] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:46.190627 5863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:22:46.191083 5863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Bootstrap complete.
I20260807 15:22:46.195461 5863 raft_consensus.cc:348] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:46.195919 5863 raft_consensus.cc:729] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 228367c6cb554c0da67490eed17a82a7, State: Initialized, Role: FOLLOWER
I20260807 15:22:46.196476 5863 consensus_queue.cc:260] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:46.196635 5863 raft_consensus.cc:388] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:22:46.196727 5863 raft_consensus.cc:482] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:22:46.196882 5863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:22:46.198871 5863 raft_consensus.cc:504] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:46.199234 5863 leader_election.cc:302] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 228367c6cb554c0da67490eed17a82a7; no voters:
I20260807 15:22:46.199613 5863 leader_election.cc:288] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 15:22:46.199707 5869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:22:46.199936 5869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 2 LEADER]: Becoming Leader. State: Replica: 228367c6cb554c0da67490eed17a82a7, State: Running, Role: LEADER
I20260807 15:22:46.200253 5869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:46.201014 5863 sys_catalog.cc:564] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:22:46.201742 5871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "228367c6cb554c0da67490eed17a82a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } } }
I20260807 15:22:46.201874 5871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:46.202521 5880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:22:46.202553 5872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 228367c6cb554c0da67490eed17a82a7. Latest consensus state: current_term: 2 leader_uuid: "228367c6cb554c0da67490eed17a82a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } } }
I20260807 15:22:46.202677 5872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:46.208273 5880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:22:46.209049 5880 catalog_manager.cc:1259] Loaded cluster ID: a41f8532407b4aaa9a6c0307d4179c93
I20260807 15:22:46.209117 5880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:22:46.210531 5880 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 15:22:46.215013 5880 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 15:22:46.221033 5880 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:22:46.221800 5880 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Loaded TSK: 0
I20260807 15:22:46.223011 5880 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 15:22:46.291955 5865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:46.292371 5865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:46.292459 5865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:46.299907 5865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:46.300004 5865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:46.300109 5865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:22:46.308537 5865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:37197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=42975
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:46.309998 5865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:46.311273 5865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:46.322649 5901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:46.322649 5903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:46.322986 5907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:46.323966 5865 server_base.cc:1034] running on GCE node
I20260807 15:22:46.324419 5865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:46.325233 5865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:46.328552 5865 hybrid_clock.cc:648] HybridClock initialized: now 1786116166328506 us; error 50 us; skew 500 ppm
Aug 07 15:22:46 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116166, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:46.331583 5865 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:22:46.332754 5865 webserver.cc:460] Webserver started at http://127.15.242.193:42975/ using document root <none> and password file <none>
I20260807 15:22:46.333362 5865 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:46.333472 5865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:46.338258 5865 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 15:22:46.341019 5923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:46.342500 5865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 15:22:46.342669 5865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "b275f72c70aa43c89058510dc4ff461d"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "4db3ebd7575bff4c1ead429c55ef87ae"
server_key_iv: "cf0316c2b4fda2464fe764495b7fe18c"
server_key_version: "encryptionkey@0"
I20260807 15:22:46.343327 5865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:46.369361 5865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:46.373042 5865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:46.373294 5865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:46.374038 5865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:46.375334 5931 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 15:22:46.379995 5865 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 15:22:46.380095 5865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260807 15:22:46.380187 5865 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 15:22:46.382048 5865 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 15:22:46.382117 5865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260807 15:22:46.382505 5931 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Bootstrap starting.
I20260807 15:22:46.398231 5865 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:37197
I20260807 15:22:46.399667 5865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:22:46.401474 6101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:37197 every 8 connection(s)
I20260807 15:22:46.410321 5931 log.cc:824] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:46.413080 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 5865
I20260807 15:22:46.413659 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:41259
--local_ip_for_outbound_sockets=127.15.242.194
--tserver_master_addrs=127.15.242.254:38459
--webserver_port=41613
--webserver_interface=127.15.242.194
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 15:22:46 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116166, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:46.430568 6106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.404148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:54627)
0807 15:22:46.404691 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:46.404750 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:46.405905 (+ 1155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:46.412959 (+ 7054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:46.412970 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:46.413608 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:46.414589 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.414616 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.416617 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.416621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.418087 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.418102 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.419471 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.419475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.419700 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.421154 (+ 1454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:46.421182 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:46.423817 (+ 2635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:46.426836 (+ 3019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:46.426845 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:46.426861 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:46.427300 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:46.427779 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:46.427782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:46.427784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:46.427966 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:46.428728 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:46.428734 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:46.429054 (+ 320us) client_negotiation.cc:769] Sending connection context
0807 15:22:46.429249 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 15:22:46.429587 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":159,"threads_started":1}
I20260807 15:22:46.430702 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.405508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:54627 (local address 127.15.242.254:38459)
0807 15:22:46.411127 (+ 5619us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.411152 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.411210 (+ 58us) server_negotiation.cc:407] Connection header received
0807 15:22:46.411520 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.411537 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.411975 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.412410 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:46.414827 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.416412 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.418249 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.419043 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.419229 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.424075 (+ 4846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:46.424084 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:46.424101 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:46.424138 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:46.426677 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.427476 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.427483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.427489 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.427660 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.428091 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.428095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.428097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.428594 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:46.428749 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.429526 (+ 777us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.429858 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5439,"thread_start_us":127,"threads_started":1}
I20260807 15:22:46.432173 5931 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:22:46.432675 5931 tablet_bootstrap.cc:492] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Bootstrap complete.
I20260807 15:22:46.433122 6103 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38459
I20260807 15:22:46.433387 6103 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:46.433897 6103 heartbeater.cc:511] Master 127.15.242.254:38459 requested a full tablet report, sending...
I20260807 15:22:46.434358 5931 ts_tablet_manager.cc:1397] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Time spent bootstrapping tablet: real 0.052s user 0.026s sys 0.008s
I20260807 15:22:46.436328 5806 ts_manager.cc:194] Registered new tserver with Master: b275f72c70aa43c89058510dc4ff461d (127.15.242.193:37197)
I20260807 15:22:46.437407 5931 raft_consensus.cc:348] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:46.437966 5931 raft_consensus.cc:729] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b275f72c70aa43c89058510dc4ff461d, State: Initialized, Role: FOLLOWER
I20260807 15:22:46.438483 5931 consensus_queue.cc:260] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } } peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } }
I20260807 15:22:46.439536 5931 ts_tablet_manager.cc:1428] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 15:22:46.440780 5806 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:54627
I20260807 15:22:46.443534 6103 heartbeater.cc:503] Master 127.15.242.254:38459 was elected leader, sending a full tablet report...
Aug 07 15:22:46 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116166, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:22:46.450870 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.439989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39654 (local address 127.15.242.193:37197)
0807 15:22:46.440445 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.440458 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.440482 (+ 24us) server_negotiation.cc:407] Connection header received
0807 15:22:46.440550 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.440555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.440749 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.440954 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:46.441792 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.442544 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.443455 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.443921 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.444043 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.446708 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:46.446719 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:46.446732 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:46.446760 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:46.448706 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.449237 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.449243 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.449245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.449351 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.449621 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.449625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.449627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.449942 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:46.450082 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.450532 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.450704 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":100,"threads_started":1}
I20260807 15:22:46.450937 6116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.439605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:37197 (local address 127.0.0.1:39654)
0807 15:22:46.440186 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:46.440234 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:46.440376 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:46.441019 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:46.441025 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:46.441486 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:46.441656 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.441665 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.442680 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.442685 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.443317 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.443326 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.444059 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.444063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.444185 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.444868 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:46.444883 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:46.446544 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:46.448865 (+ 2321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:46.448875 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:46.448886 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:46.449116 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:46.449450 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:46.449452 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:46.449453 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:46.449532 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:46.450084 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:46.450109 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:46.450266 (+ 157us) client_negotiation.cc:769] Sending connection context
0807 15:22:46.450445 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 15:22:46.450682 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":116,"threads_started":1}
I20260807 15:22:46.452056 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet c6d5433fa40144c0901957fbb284e3d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:45 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:39654
I20260807 15:22:46.452951 6118 tablet_replica.cc:330] stopping tablet replica
I20260807 15:22:46.453254 6118 raft_consensus.cc:2229] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:22:46.453506 6118 raft_consensus.cc:2258] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:22:46.454474 6118 ts_tablet_manager.cc:1905] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:22:46.457978 6118 ts_tablet_manager.cc:1918] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:22:46.458063 6118 log.cc:1196] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/c6d5433fa40144c0901957fbb284e3d0
I20260807 15:22:46.458374 6118 ts_tablet_manager.cc:1939] T c6d5433fa40144c0901957fbb284e3d0 P b275f72c70aa43c89058510dc4ff461d: Deleting consensus metadata
I20260807 15:22:46.460074 5786 catalog_manager.cc:4841] TS b275f72c70aa43c89058510dc4ff461d (127.15.242.193:37197): tablet c6d5433fa40144c0901957fbb284e3d0 (table test-table [id=003f59fed07f43998105e07d61a94d9d]) successfully deleted
W20260807 15:22:46.544539 6112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:46.544860 6112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:46.544914 6112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:46.548821 6112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:46.548866 6112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:46.548920 6112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:22:46.554049 6112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:41259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=41613
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:46.555020 6112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:46.555999 6112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:46.565750 6127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:46.565773 6124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:46.565779 6129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:46.566099 6112 server_base.cc:1034] running on GCE node
I20260807 15:22:46.566502 6112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:46.567246 6112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:46.568435 6112 hybrid_clock.cc:648] HybridClock initialized: now 1786116166568421 us; error 25 us; skew 500 ppm
Aug 07 15:22:46 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116166, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:46.571274 6112 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:22:46.572160 6112 webserver.cc:460] Webserver started at http://127.15.242.194:41613/ using document root <none> and password file <none>
I20260807 15:22:46.572736 6112 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:46.572878 6112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:46.576614 6112 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:22:46.578751 6137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:46.580083 6112 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:22:46.580226 6112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "1e8f867595c746c095627dadc82a5d6b"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "74fe3ee5feff861241bf5004255df407"
server_key_iv: "6e511ec21615e78a0365cc31955ebf45"
server_key_version: "encryptionkey@0"
I20260807 15:22:46.580845 6112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:46.595826 6112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:46.598758 6112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:46.598914 6112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:46.599453 6112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:46.600236 6112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:46.600283 6112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:46.600324 6112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:46.600340 6112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:46.610143 6112 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:41259
I20260807 15:22:46.610179 6301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:41259 every 8 connection(s)
I20260807 15:22:46.611137 6112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:22:46.612668 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 6112
I20260807 15:22:46.613242 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:44849
--local_ip_for_outbound_sockets=127.15.242.195
--tserver_master_addrs=127.15.242.254:38459
--webserver_port=36165
--webserver_interface=127.15.242.195
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 15:22:46 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116166, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:46.627580 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.613034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:37051 (local address 127.15.242.254:38459)
0807 15:22:46.613211 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.613217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.614383 (+ 1166us) server_negotiation.cc:407] Connection header received
0807 15:22:46.616093 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.616099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.616172 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.616278 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:46.617832 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.618374 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.620341 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.620579 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.620662 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.623677 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:46.623681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:46.623683 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:46.623707 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:46.625265 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.625912 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.625920 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.625922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.625999 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.626370 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.626374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.626376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.626618 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:46.626734 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.627340 (+ 606us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.627455 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 15:22:46.628607 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.613603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:37051)
0807 15:22:46.614175 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:46.614243 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:46.615848 (+ 1605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:46.616435 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:46.616441 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:46.616944 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:46.617646 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.617670 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.618513 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.618519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.620174 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.620192 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.620748 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.620754 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.621018 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.621708 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:46.621735 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:46.623489 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:46.625411 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:46.625417 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:46.625432 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:46.625787 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:46.626101 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:46.626104 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:46.626106 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:46.626256 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:46.626755 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:46.626762 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:46.627058 (+ 296us) client_negotiation.cc:769] Sending connection context
0807 15:22:46.627266 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 15:22:46.627590 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":132,"threads_started":1}
I20260807 15:22:46.629958 6302 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38459
I20260807 15:22:46.630230 6302 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:46.630918 6302 heartbeater.cc:511] Master 127.15.242.254:38459 requested a full tablet report, sending...
I20260807 15:22:46.632714 5806 ts_manager.cc:194] Registered new tserver with Master: 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259)
I20260807 15:22:46.633455 5806 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:37051
W20260807 15:22:46.734788 6305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:46.735034 6305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:46.735077 6305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:46.738983 6305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:46.739034 6305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:46.739089 6305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:22:46.744112 6305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:44849
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=36165
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:46.745092 6305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:46.746049 6305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:46.755980 6315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:46.756006 6305 server_base.cc:1034] running on GCE node
W20260807 15:22:46.755970 6311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:46.755970 6312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:46.756655 6305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:46.757332 6305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:46.758531 6305 hybrid_clock.cc:648] HybridClock initialized: now 1786116166758515 us; error 32 us; skew 500 ppm
Aug 07 15:22:46 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116166, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:46.761655 6305 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:22:46.762641 6305 webserver.cc:460] Webserver started at http://127.15.242.195:36165/ using document root <none> and password file <none>
I20260807 15:22:46.763159 6305 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:46.763232 6305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:46.767230 6305 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 15:22:46.769346 6330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:46.770721 6305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:22:46.770862 6305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "7f8ed969d66a4d0f8338d7d4f99eeece"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "2aa811112ada2f5ea25b20e085f91145"
server_key_iv: "366df8344ae31c731dacc1271a8a0841"
server_key_version: "encryptionkey@0"
I20260807 15:22:46.771406 6305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:46.782955 6305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:46.786216 6305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:46.786419 6305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:46.786993 6305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:46.787813 6305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:46.787885 6305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:46.787951 6305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:46.787995 6305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:46.797959 6305 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:44849
I20260807 15:22:46.798009 6495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:44849 every 8 connection(s)
I20260807 15:22:46.798985 6305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:22:46.801668 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 6305
Aug 07 15:22:46 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116166, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:22:46.811959 6503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.802766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40698 (local address 127.15.242.254:38459)
0807 15:22:46.803009 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.803012 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.803026 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:22:46.803173 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.803175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.803224 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.803308 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:46.804221 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.804939 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.806039 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.806383 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.806506 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.808138 (+ 1632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:46.808143 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:46.808145 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:46.808174 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:46.809871 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.810384 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.810388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.810390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.810482 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.810910 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.810918 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.810923 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.811185 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:46.811432 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.811589 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.811713 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":86,"threads_started":1}
I20260807 15:22:46.815608 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.800922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:60729 (local address 127.15.242.254:38459)
0807 15:22:46.801072 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.801077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.802204 (+ 1127us) server_negotiation.cc:407] Connection header received
0807 15:22:46.804232 (+ 2028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.804235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.804280 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.804365 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:46.805716 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.806423 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.808147 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.808523 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.808647 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.811608 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:46.811614 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:46.811620 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:46.811654 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:46.813328 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.814132 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.814136 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.814138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.814233 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:46.814595 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:46.814597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:46.814598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:46.814752 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:46.814825 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.815386 (+ 561us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.815490 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":53}
I20260807 15:22:46.816495 6499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.801455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:60729)
0807 15:22:46.802012 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:46.802075 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:46.803979 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:46.804496 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:46.804502 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:46.804929 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:46.805566 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.805584 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.806552 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.806556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.808025 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.808038 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.808747 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.808757 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.808960 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.809528 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:46.809543 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:46.811409 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:46.813452 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:46.813459 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:46.813473 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:46.814000 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:46.814340 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:46.814343 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:46.814344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:46.814496 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:46.814855 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:46.814860 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:46.815101 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 15:22:46.815272 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 15:22:46.815525 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":162,"threads_started":1}
I20260807 15:22:46.817838 6496 heartbeater.cc:347] Connected to a master server at 127.15.242.254:38459
I20260807 15:22:46.818130 6496 heartbeater.cc:464] Registering TS with master...
I20260807 15:22:46.818681 6496 heartbeater.cc:511] Master 127.15.242.254:38459 requested a full tablet report, sending...
I20260807 15:22:46.819871 5806 ts_manager.cc:194] Registered new tserver with Master: 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849)
I20260807 15:22:46.820410 5806 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:60729
I20260807 15:22:46.826160 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:22:46.830667 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.826819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40702 (local address 127.15.242.254:38459)
0807 15:22:46.826942 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.826949 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.827116 (+ 167us) server_negotiation.cc:407] Connection header received
0807 15:22:46.827252 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.827254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.827347 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.827439 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:22:46.827794 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.828280 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.829376 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.829586 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.829679 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.829998 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:22:46.830349 (+ 351us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:22:46.830438 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.830536 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.830580 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 15:22:46.831347 5806 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40702:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:22:46.834717 5806 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:22:46.843478 5992 tablet_service.cc:1467] Processing CreateTablet for tablet fb820952773841a795c95db83759359e (DEFAULT_TABLE table=test-table [id=29e0d7afb00e40288b556d267a628752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:46.844269 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb820952773841a795c95db83759359e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:46.847357 5931 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Bootstrap starting.
I20260807 15:22:46.848275 5931 tablet_bootstrap.cc:654] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:46.848865 6116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.842343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44849 (local address 127.0.0.1:45000)
0807 15:22:46.842465 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:46.842483 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:46.842573 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:46.844211 (+ 1638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:46.844216 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:46.844237 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:46.844333 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.844340 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.845807 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.845814 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.847073 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.847085 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.848254 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.848259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.848368 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.848426 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 15:22:46.848526 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 15:22:46.848670 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":46}
I20260807 15:22:46.848907 6511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.842588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45000 (local address 127.15.242.195:44849)
0807 15:22:46.843413 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.843429 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.843456 (+ 27us) server_negotiation.cc:407] Connection header received
0807 15:22:46.843547 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.843553 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.843803 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.843981 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:46.844479 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.845619 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.847249 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.848104 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.848246 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.848388 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.848566 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.848721 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":193,"threads_started":1}
I20260807 15:22:46.849624 6510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.842617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:41259 (local address 127.0.0.1:45560)
0807 15:22:46.843032 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:46.843044 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:46.843127 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:46.843979 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:46.843982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:46.844002 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:46.844117 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.844128 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.845673 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.845676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.847075 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.847087 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.849176 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.849180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.849312 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.849350 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 15:22:46.849423 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 15:22:46.849488 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":94,"thread_start_us":148,"threads_started":1}
I20260807 15:22:46.850030 6512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.843091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45560 (local address 127.15.242.194:41259)
0807 15:22:46.843497 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.843513 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.843532 (+ 19us) server_negotiation.cc:407] Connection header received
0807 15:22:46.843599 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.843603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.843802 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.843994 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:46.844255 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.845517 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.847215 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.848104 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.848246 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.848389 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.849614 (+ 1225us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.849871 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":162,"threads_started":1}
I20260807 15:22:46.850644 5931 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: No bootstrap required, opened a new log
I20260807 15:22:46.850756 5931 ts_tablet_manager.cc:1397] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 15:22:46.851226 5931 raft_consensus.cc:348] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.851357 5931 raft_consensus.cc:374] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:46.851397 5931 raft_consensus.cc:729] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b275f72c70aa43c89058510dc4ff461d, State: Initialized, Role: FOLLOWER
I20260807 15:22:46.851565 5931 consensus_queue.cc:260] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.851950 5931 ts_tablet_manager.cc:1428] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:22:46.852224 6397 tablet_service.cc:1467] Processing CreateTablet for tablet fb820952773841a795c95db83759359e (DEFAULT_TABLE table=test-table [id=29e0d7afb00e40288b556d267a628752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:46.853384 6397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb820952773841a795c95db83759359e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:46.853014 6207 tablet_service.cc:1467] Processing CreateTablet for tablet fb820952773841a795c95db83759359e (DEFAULT_TABLE table=test-table [id=29e0d7afb00e40288b556d267a628752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:22:46.854133 6207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb820952773841a795c95db83759359e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:22:46.860474 6517 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: Bootstrap starting.
I20260807 15:22:46.860411 6515 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: Bootstrap starting.
I20260807 15:22:46.862926 6517 tablet_bootstrap.cc:654] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:46.863003 6515 tablet_bootstrap.cc:654] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: Neither blocks nor log segments found. Creating new log.
I20260807 15:22:46.863680 6517 log.cc:824] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:46.864120 6515 log.cc:824] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:46.865950 6517 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: No bootstrap required, opened a new log
I20260807 15:22:46.866153 6517 ts_tablet_manager.cc:1397] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:22:46.866276 6515 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: No bootstrap required, opened a new log
I20260807 15:22:46.866464 6515 ts_tablet_manager.cc:1397] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:22:46.869019 6517 raft_consensus.cc:348] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.869231 6517 raft_consensus.cc:374] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:46.869295 6517 raft_consensus.cc:729] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8f867595c746c095627dadc82a5d6b, State: Initialized, Role: FOLLOWER
I20260807 15:22:46.869450 6515 raft_consensus.cc:348] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.869688 6515 raft_consensus.cc:374] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:22:46.869761 6515 raft_consensus.cc:729] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f8ed969d66a4d0f8338d7d4f99eeece, State: Initialized, Role: FOLLOWER
I20260807 15:22:46.869791 6517 consensus_queue.cc:260] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.870177 6515 consensus_queue.cc:260] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.870471 6302 heartbeater.cc:503] Master 127.15.242.254:38459 was elected leader, sending a full tablet report...
I20260807 15:22:46.870815 6496 heartbeater.cc:503] Master 127.15.242.254:38459 was elected leader, sending a full tablet report...
I20260807 15:22:46.870834 6517 ts_tablet_manager.cc:1428] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 15:22:46.872311 6515 ts_tablet_manager.cc:1428] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260807 15:22:46.902743 6104 tablet.cc:2369] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:22:46.940783 6113 raft_consensus.cc:482] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:22:46.941116 6113 raft_consensus.cc:504] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.942360 6113 leader_election.cc:288] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849), 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259)
I20260807 15:22:46.947729 6528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.943168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:41259 (local address 127.15.242.193:36645)
0807 15:22:46.943520 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:46.943536 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:46.943696 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:46.943999 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:46.944030 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:46.944058 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:46.944186 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.944193 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.945036 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.945039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.946204 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.946215 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.947205 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.947208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.947321 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.947382 (+ 61us) client_negotiation.cc:769] Sending connection context
0807 15:22:46.947467 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 15:22:46.947559 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":19,"thread_start_us":74,"threads_started":1}
I20260807 15:22:46.947768 6512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.943276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:36645 (local address 127.15.242.194:41259)
0807 15:22:46.943459 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.943466 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.943691 (+ 225us) server_negotiation.cc:407] Connection header received
0807 15:22:46.943793 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.943797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.943850 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.943959 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:46.944321 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.944929 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.946358 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.947068 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.947226 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.947310 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.947531 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.947635 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 15:22:46.947786 6524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.942684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44849 (local address 127.15.242.193:50583)
0807 15:22:46.943070 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:46.943093 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:46.943273 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:46.943734 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:46.943738 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:46.943776 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:22:46.943936 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.943948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.944889 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.944894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.946418 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:46.946430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.947349 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.947352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:46.947458 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.947482 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 15:22:46.947547 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 15:22:46.947599 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":203,"thread_start_us":143,"threads_started":1}
I20260807 15:22:46.947811 6511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.942849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:50583 (local address 127.15.242.195:44849)
0807 15:22:46.943037 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.943043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.943186 (+ 143us) server_negotiation.cc:407] Connection header received
0807 15:22:46.943507 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.943511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.943580 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.943668 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:22:46.944084 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.944737 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.946533 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.947217 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.947353 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.947402 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.947610 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.947692 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 15:22:46.948690 6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb820952773841a795c95db83759359e" candidate_uuid: "b275f72c70aa43c89058510dc4ff461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8f867595c746c095627dadc82a5d6b" is_pre_election: true
I20260807 15:22:46.948710 6426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb820952773841a795c95db83759359e" candidate_uuid: "b275f72c70aa43c89058510dc4ff461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" is_pre_election: true
I20260807 15:22:46.949062 6236 raft_consensus.cc:2454] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b275f72c70aa43c89058510dc4ff461d in term 0.
I20260807 15:22:46.949098 6426 raft_consensus.cc:2454] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b275f72c70aa43c89058510dc4ff461d in term 0.
I20260807 15:22:46.949654 5924 leader_election.cc:302] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f8ed969d66a4d0f8338d7d4f99eeece, b275f72c70aa43c89058510dc4ff461d; no voters:
I20260807 15:22:46.949945 6113 raft_consensus.cc:2781] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:22:46.950049 6113 raft_consensus.cc:482] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:22:46.950109 6113 raft_consensus.cc:3037] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:46.951308 6113 raft_consensus.cc:504] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.951694 6113 leader_election.cc:288] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 1 election: Requested vote from peers 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849), 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259)
I20260807 15:22:46.952113 6426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb820952773841a795c95db83759359e" candidate_uuid: "b275f72c70aa43c89058510dc4ff461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece"
I20260807 15:22:46.952190 6236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb820952773841a795c95db83759359e" candidate_uuid: "b275f72c70aa43c89058510dc4ff461d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8f867595c746c095627dadc82a5d6b"
I20260807 15:22:46.952260 6426 raft_consensus.cc:3037] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:46.952315 6236 raft_consensus.cc:3037] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:22:46.953732 6236 raft_consensus.cc:2454] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b275f72c70aa43c89058510dc4ff461d in term 1.
I20260807 15:22:46.953732 6426 raft_consensus.cc:2454] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b275f72c70aa43c89058510dc4ff461d in term 1.
I20260807 15:22:46.954067 5924 leader_election.cc:302] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8f867595c746c095627dadc82a5d6b, b275f72c70aa43c89058510dc4ff461d; no voters:
I20260807 15:22:46.954282 6113 raft_consensus.cc:2781] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:22:46.954484 6113 raft_consensus.cc:686] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 LEADER]: Becoming Leader. State: Replica: b275f72c70aa43c89058510dc4ff461d, State: Running, Role: LEADER
I20260807 15:22:46.954789 6113 consensus_queue.cc:237] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:46.958199 5805 catalog_manager.cc:5495] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d reported cstate change: term changed from 0 to 1, leader changed from <none> to b275f72c70aa43c89058510dc4ff461d (127.15.242.193). New cstate: current_term: 1 leader_uuid: "b275f72c70aa43c89058510dc4ff461d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } health_report { overall_health: HEALTHY } } }
I20260807 15:22:46.981892 6537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:46.977562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39660 (local address 127.15.242.193:37197)
0807 15:22:46.977867 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:46.977871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:46.977885 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:22:46.977972 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:46.977974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:46.978037 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:46.978152 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:22:46.978463 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.979104 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.980013 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:46.980276 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:46.980378 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:46.980661 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:22:46.981311 (+ 650us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:22:46.981425 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:46.981556 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 15:22:46.981615 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":130,"threads_started":1}
I20260807 15:22:46.986965 6236 raft_consensus.cc:1261] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 1 FOLLOWER]: Refusing update from remote peer b275f72c70aa43c89058510dc4ff461d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:22:46.986956 6426 raft_consensus.cc:1261] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 1 FOLLOWER]: Refusing update from remote peer b275f72c70aa43c89058510dc4ff461d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:22:46.987951 6113 consensus_queue.cc:1035] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:22:46.988270 6531 consensus_queue.cc:1035] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:22:46.999056 6541 mvcc.cc:205] Tried to move back new op lower bound from 7315931819969277952 to 7315931819849756672. Current Snapshot: MvccSnapshot[applied={T|T < 7315931819969277952}]
I20260807 15:22:46.999542 6540 mvcc.cc:205] Tried to move back new op lower bound from 7315931819969277952 to 7315931819849756672. Current Snapshot: MvccSnapshot[applied={T|T < 7315931819969277952}]
I20260807 15:22:47.006691 5806 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:22:47.006896 5806 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:22:47.009829 5806 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Sending DeleteTablet for 3 replicas of tablet fb820952773841a795c95db83759359e
I20260807 15:22:47.010744 5992 tablet_service.cc:1514] Processing DeleteTablet for tablet fb820952773841a795c95db83759359e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:47 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:39654
I20260807 15:22:47.010937 6397 tablet_service.cc:1514] Processing DeleteTablet for tablet fb820952773841a795c95db83759359e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:47 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:45000
I20260807 15:22:47.010929 6207 tablet_service.cc:1514] Processing DeleteTablet for tablet fb820952773841a795c95db83759359e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:22:47 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:45560
I20260807 15:22:47.011413 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 5865
I20260807 15:22:47.011546 6554 tablet_replica.cc:330] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: stopping tablet replica
I20260807 15:22:47.011729 6554 raft_consensus.cc:2229] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:22:47.014242 6557 tablet_replica.cc:330] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: stopping tablet replica
I20260807 15:22:47.014752 6557 raft_consensus.cc:2229] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:22:47.015213 6557 raft_consensus.cc:2258] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:22:47.015765 6556 tablet_replica.cc:330] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: stopping tablet replica
I20260807 15:22:47.016139 6556 raft_consensus.cc:2229] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:22:47.016471 6556 raft_consensus.cc:2258] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:22:47.017824 6557 ts_tablet_manager.cc:1905] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:22:47.018831 6556 ts_tablet_manager.cc:1905] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:22:47.022238 6556 ts_tablet_manager.cc:1918] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:22:47.022356 6556 log.cc:1196] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/fb820952773841a795c95db83759359e
I20260807 15:22:47.022531 6557 ts_tablet_manager.cc:1918] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:22:47.022719 6556 ts_tablet_manager.cc:1939] T fb820952773841a795c95db83759359e P 7f8ed969d66a4d0f8338d7d4f99eeece: Deleting consensus metadata
I20260807 15:22:47.022856 6557 log.cc:1196] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/fb820952773841a795c95db83759359e
I20260807 15:22:47.023484 6557 ts_tablet_manager.cc:1939] T fb820952773841a795c95db83759359e P 1e8f867595c746c095627dadc82a5d6b: Deleting consensus metadata
I20260807 15:22:47.024150 5781 catalog_manager.cc:4841] TS 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849): tablet fb820952773841a795c95db83759359e (table test-table [id=29e0d7afb00e40288b556d267a628752]) successfully deleted
I20260807 15:22:47.025089 5781 catalog_manager.cc:4841] TS 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259): tablet fb820952773841a795c95db83759359e (table test-table [id=29e0d7afb00e40288b556d267a628752]) successfully deleted
W20260807 15:22:47.031124 5786 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:37197 (error 108)
I20260807 15:22:47.031785 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 6112
I20260807 15:22:47.037595 6510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.032028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:37197 (local address 127.0.0.1:39666)
0807 15:22:47.037379 (+ 5351us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.037475 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:37197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5220}
W20260807 15:22:47.043943 5786 catalog_manager.cc:4584] TS b275f72c70aa43c89058510dc4ff461d (127.15.242.193:37197): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fb820952773841a795c95db83759359e: Network error: Client connection negotiation failed: client connection to 127.15.242.193:37197: connect: Connection refused (error 111)
I20260807 15:22:47.050313 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 6305
I20260807 15:22:47.065871 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 5757
I20260807 15:22:47.079255 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38459
--webserver_interface=127.15.242.254
--webserver_port=38863
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:22:47.196681 6559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:47.197005 6559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:47.197044 6559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:47.200941 6559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:22:47.200992 6559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:47.201011 6559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:47.201027 6559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:22:47.201042 6559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:22:47.206174 6559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=38863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:47.207147 6559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:47.208091 6559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:47.217041 6568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:47.217072 6565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:47.217126 6559 server_base.cc:1034] running on GCE node
W20260807 15:22:47.217072 6570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:47.217797 6559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:47.218874 6559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:47.220038 6559 hybrid_clock.cc:648] HybridClock initialized: now 1786116167220024 us; error 28 us; skew 500 ppm
Aug 07 15:22:47 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116167, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:47.223093 6559 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:22:47.224038 6559 webserver.cc:460] Webserver started at http://127.15.242.254:38863/ using document root <none> and password file <none>
I20260807 15:22:47.224603 6559 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:47.224709 6559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:47.228601 6559 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:22:47.230830 6582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:47.232028 6559 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:22:47.232167 6559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "228367c6cb554c0da67490eed17a82a7"
format_stamp: "Formatted at 2026-08-07 15:22:44 on dist-test-slave-g170"
server_key: "a15e9b4f5ffa6cf816d32774ed68cb37"
server_key_iv: "ae203e3c1fe6523fe262d82c70fce72a"
server_key_version: "encryptionkey@0"
I20260807 15:22:47.232731 6559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:47.255224 6559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:47.258693 6559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:47.258912 6559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:47.266685 6559 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38459
I20260807 15:22:47.267077 6656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38459 every 8 connection(s)
I20260807 15:22:47.267910 6559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:22:47.272679 6657 sys_catalog.cc:263] Verifying existing consensus state
I20260807 15:22:47.274695 6657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Bootstrap starting.
I20260807 15:22:47.276952 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 6559
I20260807 15:22:47.277416 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:37197
--local_ip_for_outbound_sockets=127.15.242.193
--tserver_master_addrs=127.15.242.254:38459
--webserver_port=42975
--webserver_interface=127.15.242.193
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:22:47.295378 6657 log.cc:824] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:47.307796 6657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:22:47.308228 6657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7: Bootstrap complete.
I20260807 15:22:47.312932 6657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:47.313381 6657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 228367c6cb554c0da67490eed17a82a7, State: Initialized, Role: FOLLOWER
I20260807 15:22:47.313927 6657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:47.314111 6657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:22:47.314219 6657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:22:47.314354 6657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:22:47.316413 6657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:47.316836 6657 leader_election.cc:302] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 228367c6cb554c0da67490eed17a82a7; no voters:
I20260807 15:22:47.317214 6657 leader_election.cc:288] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 15:22:47.317303 6667 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:22:47.317517 6667 raft_consensus.cc:686] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [term 3 LEADER]: Becoming Leader. State: Replica: 228367c6cb554c0da67490eed17a82a7, State: Running, Role: LEADER
I20260807 15:22:47.317835 6667 consensus_queue.cc:237] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } }
I20260807 15:22:47.318581 6657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:22:47.318861 6667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 228367c6cb554c0da67490eed17a82a7. Latest consensus state: current_term: 3 leader_uuid: "228367c6cb554c0da67490eed17a82a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } } }
I20260807 15:22:47.318987 6667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:47.319401 6674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:22:47.319373 6670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "228367c6cb554c0da67490eed17a82a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228367c6cb554c0da67490eed17a82a7" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38459 } } }
I20260807 15:22:47.319584 6670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228367c6cb554c0da67490eed17a82a7 [sys.catalog]: This master's current role is: LEADER
I20260807 15:22:47.325263 6674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:22:47.326027 6674 catalog_manager.cc:1259] Loaded cluster ID: a41f8532407b4aaa9a6c0307d4179c93
I20260807 15:22:47.326113 6674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 15:22:47.327147 6674 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f3cf26649ad google::LogMessage::Fail() at ??:0
@ 0x7f3cf266788a google::LogMessage::SendToLog() at ??:0
@ 0x7f3cf26644de google::LogMessage::Flush() at ??:0
@ 0x7f3cf2665a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f3cfcfa3fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f3cfcfa4d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f3cfcfa1579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f3cfcfe5640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f3cf48b63d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3cf48b6c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f3cf48b83f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f3cf48a7512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f3cf5eeb6db start_thread at ??:0
@ 0x7f3cf116261f clone at ??:0
W20260807 15:22:47.428563 6663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:47.428903 6663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:47.428987 6663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:47.433070 6663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:47.433123 6663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:47.433214 6663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:22:47.438704 6663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:37197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=42975
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:47.439828 6663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:47.440958 6663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:47.450947 6736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:47.450963 6732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:47.451012 6733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:47.451531 6663 server_base.cc:1034] running on GCE node
I20260807 15:22:47.451924 6663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:47.452602 6663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:47.453817 6663 hybrid_clock.cc:648] HybridClock initialized: now 1786116167453795 us; error 58 us; skew 500 ppm
Aug 07 15:22:47 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116167, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:47.457056 6663 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:22:47.458184 6663 webserver.cc:460] Webserver started at http://127.15.242.193:42975/ using document root <none> and password file <none>
I20260807 15:22:47.458952 6663 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:47.459051 6663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:47.464295 6663 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:22:47.467352 6747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:47.471470 6663 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.002s
I20260807 15:22:47.471617 6663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "b275f72c70aa43c89058510dc4ff461d"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "4db3ebd7575bff4c1ead429c55ef87ae"
server_key_iv: "cf0316c2b4fda2464fe764495b7fe18c"
server_key_version: "encryptionkey@0"
I20260807 15:22:47.472399 6663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:47.487345 6663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:47.490957 6663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:47.491178 6663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:47.491812 6663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:47.493013 6758 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 15:22:47.498848 6663 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 15:22:47.498935 6663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260807 15:22:47.499037 6663 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 15:22:47.500756 6663 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 15:22:47.500870 6663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260807 15:22:47.501214 6758 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Bootstrap starting.
I20260807 15:22:47.513679 6663 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:37197
I20260807 15:22:47.513919 6915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:37197 every 8 connection(s)
I20260807 15:22:47.514781 6663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:22:47.516403 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 6663
I20260807 15:22:47.516963 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:41259
--local_ip_for_outbound_sockets=127.15.242.194
--tserver_master_addrs=127.15.242.254:38459
--webserver_port=41613
--webserver_interface=127.15.242.194
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:22:47.525995 6758 log.cc:824] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Log is configured to *not* fsync() on all Append() calls
I20260807 15:22:47.536008 6758 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:22:47.536513 6758 tablet_bootstrap.cc:492] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Bootstrap complete.
I20260807 15:22:47.538262 6758 ts_tablet_manager.cc:1397] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Time spent bootstrapping tablet: real 0.037s user 0.031s sys 0.004s
I20260807 15:22:47.541834 6758 raft_consensus.cc:348] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:47.542380 6758 raft_consensus.cc:729] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b275f72c70aa43c89058510dc4ff461d, State: Initialized, Role: FOLLOWER
I20260807 15:22:47.543066 6758 consensus_queue.cc:260] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:47.544216 6758 ts_tablet_manager.cc:1428] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260807 15:22:47.566382 6922 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:22:47.517162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:42519)
0807 15:22:47.518744 (+ 1582us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.518812 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:47.520173 (+ 1361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:47.565554 (+ 45381us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1293,"thread_start_us":146,"threads_started":1}
W20260807 15:22:47.567056 6919 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:38459 (0 consecutive failures): Network error: Failed to ping master at 127.15.242.254:38459: Client connection negotiation failed: client connection to 127.15.242.254:38459: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 15:22:47.567829 6922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.567574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:38909)
0807 15:22:47.567711 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.567775 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 15:22:47.568480 6922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.568267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:60455)
0807 15:22:47.568382 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.568432 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 15:22:47.568648 6919 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 15:22:47.645279 6923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:47.645555 6923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:47.645643 6923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:47.650231 6923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:47.650307 6923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:47.650399 6923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:22:47.655752 6923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:41259
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=41613
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:47.656876 6923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:47.657895 6923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:22:47.668008 6934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:47.668010 6936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:47.668040 6932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:47.668087 6923 server_base.cc:1034] running on GCE node
I20260807 15:22:47.668665 6923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:47.669380 6923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:47.670569 6923 hybrid_clock.cc:648] HybridClock initialized: now 1786116167670537 us; error 42 us; skew 500 ppm
Aug 07 15:22:47 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116167, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:47.673565 6923 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:22:47.674551 6923 webserver.cc:460] Webserver started at http://127.15.242.194:41613/ using document root <none> and password file <none>
I20260807 15:22:47.675184 6923 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:47.675295 6923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:47.679623 6923 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 15:22:47.681926 6949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:47.683194 6923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 15:22:47.683357 6923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "1e8f867595c746c095627dadc82a5d6b"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "74fe3ee5feff861241bf5004255df407"
server_key_iv: "6e511ec21615e78a0365cc31955ebf45"
server_key_version: "encryptionkey@0"
I20260807 15:22:47.683902 6923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:47.695390 6923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:47.698764 6923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:47.698992 6923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:47.699647 6923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:47.700560 6923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:47.700613 6923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:47.700688 6923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:47.700732 6923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:47.710542 6923 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:41259
I20260807 15:22:47.710614 7121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:41259 every 8 connection(s)
I20260807 15:22:47.711684 6923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:22:47.715899 7124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.714000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:35425)
0807 15:22:47.714533 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.714640 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":134,"threads_started":1}
I20260807 15:22:47.716131 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 6923
W20260807 15:22:47.716490 7122 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:38459 (0 consecutive failures): Network error: Failed to ping master at 127.15.242.254:38459: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
I20260807 15:22:47.716835 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:44849
--local_ip_for_outbound_sockets=127.15.242.195
--tserver_master_addrs=127.15.242.254:38459
--webserver_port=36165
--webserver_interface=127.15.242.195
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:22:47.717272 7124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.716992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:33209)
0807 15:22:47.717148 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.717196 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 15:22:47.717980 7124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.717790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:36673)
0807 15:22:47.717895 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.717935 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 15:22:47.718201 7122 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 15:22:47.846000 7127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:22:47.846312 7127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:22:47.846361 7127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:22:47.850771 7127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:22:47.850847 7127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:22:47.850912 7127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:22:47.856686 7127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:44849
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=36165
--tserver_master_addrs=127.15.242.254:38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:22:47.857823 7127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:22:47.858886 7127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:22:47.869234 7127 server_base.cc:1034] running on GCE node
W20260807 15:22:47.869258 7133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:47.869423 7141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:22:47.869309 7135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:22:47.869946 7127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:22:47.870697 7127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:22:47.871896 7127 hybrid_clock.cc:648] HybridClock initialized: now 1786116167871865 us; error 47 us; skew 500 ppm
Aug 07 15:22:47 dist-test-slave-g170 krb5kdc[4859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116167, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:22:47.875308 7127 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:22:47.876147 7127 webserver.cc:460] Webserver started at http://127.15.242.195:36165/ using document root <none> and password file <none>
I20260807 15:22:47.876694 7127 fs_manager.cc:359] Metadata directory not provided
I20260807 15:22:47.876811 7127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:22:47.881184 7127 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 15:22:47.883436 7150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:47.884836 7127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:22:47.884939 7127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "7f8ed969d66a4d0f8338d7d4f99eeece"
format_stamp: "Formatted at 2026-08-07 15:22:45 on dist-test-slave-g170"
server_key: "2aa811112ada2f5ea25b20e085f91145"
server_key_iv: "366df8344ae31c731dacc1271a8a0841"
server_key_version: "encryptionkey@0"
I20260807 15:22:47.885499 7127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:22:47.909435 7127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:22:47.913091 7127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:22:47.913290 7127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:22:47.913898 7127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:22:47.914812 7127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:22:47.914862 7127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:47.914906 7127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:22:47.914920 7127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:22:47.925058 7127 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:44849
I20260807 15:22:47.925552 7315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:44849 every 8 connection(s)
I20260807 15:22:47.926630 7127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:22:47.932253 7319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.929678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:38835)
0807 15:22:47.930349 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.930521 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":163,"threads_started":1}
W20260807 15:22:47.935201 7316 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:38459 (0 consecutive failures): Network error: Failed to ping master at 127.15.242.254:38459: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
I20260807 15:22:47.936012 7319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.935744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:59773)
0807 15:22:47.935866 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.935932 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 15:22:47.936621 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 7127
I20260807 15:22:47.937974 7319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:47.936953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:55081)
0807 15:22:47.937752 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:47.937820 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":700}
W20260807 15:22:47.938252 7316 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 15:22:48.569692 7322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:48.569238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:60361)
0807 15:22:48.569530 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:48.569584 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":80,"threads_started":1}
I20260807 15:22:48.719506 7323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:48.719020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:39593)
0807 15:22:48.719324 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:48.719391 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":81,"threads_started":1}
I20260807 15:22:48.939471 7324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:48.938988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:35917)
0807 15:22:48.939281 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:48.939349 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":84,"threads_started":1}
I20260807 15:22:49.113986 7326 raft_consensus.cc:482] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:22:49.114244 7326 raft_consensus.cc:504] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:49.115451 7326 leader_election.cc:288] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849), 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259)
Aug 07 15:22:49 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116167, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.194@KRBTEST.COM
Aug 07 15:22:49 dist-test-slave-g170 krb5kdc[4859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116167, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.195@KRBTEST.COM
I20260807 15:22:49.133968 7329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:49.116104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:41259 (local address 127.15.242.193:43143)
0807 15:22:49.116436 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:49.116447 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:49.116542 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:49.118062 (+ 1520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:49.118065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:49.118642 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:49.119092 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:49.119109 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:49.120418 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:49.120422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:49.121486 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:49.121497 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:49.122222 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:49.122226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:49.122426 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:49.127080 (+ 4654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:49.127103 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:49.129051 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:49.131388 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:49.131395 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:49.131410 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:49.131675 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:49.132050 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:49.132053 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:49.132055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:49.132205 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:49.132934 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:49.132942 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:49.133190 (+ 248us) client_negotiation.cc:769] Sending connection context
0807 15:22:49.133389 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 15:22:49.133778 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":130,"spinlock_wait_cycles":37120,"thread_start_us":51,"threads_started":1}
I20260807 15:22:49.133981 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:49.116456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:43143 (local address 127.15.242.194:41259)
0807 15:22:49.116817 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:49.116849 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:49.116881 (+ 32us) server_negotiation.cc:407] Connection header received
0807 15:22:49.117527 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:49.117533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:49.117837 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:49.118140 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:49.119291 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:49.120262 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:49.121618 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:49.122084 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:49.122276 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:49.129354 (+ 7078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:49.129361 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:49.129376 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:49.129409 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:49.131209 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:49.131811 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:49.131822 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:49.131826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:49.131944 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:49.132307 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:49.132310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:49.132312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:49.132807 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:49.132968 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:49.133502 (+ 534us) server_negotiation.cc:299] Negotiation successful
0807 15:22:49.133769 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":90,"threads_started":1}
I20260807 15:22:49.134042 7327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:49.115655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44849 (local address 127.15.242.193:33649)
0807 15:22:49.115997 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:49.116015 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:22:49.116176 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:22:49.118015 (+ 1839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:22:49.118022 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:22:49.118615 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:22:49.119093 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:49.119109 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:49.120418 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:49.120426 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:49.121488 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:22:49.121499 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:22:49.122218 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:22:49.122222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:22:49.122422 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:49.127073 (+ 4651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:22:49.127093 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:22:49.129198 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:22:49.131673 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:49.131677 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:49.131679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:49.131886 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:49.132248 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:22:49.132251 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:22:49.132253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:22:49.132344 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:22:49.133039 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:22:49.133042 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:22:49.133196 (+ 154us) client_negotiation.cc:769] Sending connection context
0807 15:22:49.133390 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 15:22:49.133870 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":263,"spinlock_wait_cycles":8064,"thread_start_us":159,"threads_started":1}
I20260807 15:22:49.133991 7328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:49.115898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:33649 (local address 127.15.242.195:44849)
0807 15:22:49.116263 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0807 15:22:49.116300 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0807 15:22:49.116372 (+ 72us) server_negotiation.cc:407] Connection header received
0807 15:22:49.117239 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:22:49.117248 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:22:49.117629 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:22:49.117957 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:22:49.119287 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:49.120267 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:49.121616 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:22:49.122084 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:22:49.122284 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:22:49.129452 (+ 7168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:22:49.129458 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:22:49.129472 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:22:49.129505 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:22:49.131550 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:49.132017 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:49.132022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:49.132026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:49.132137 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:22:49.132441 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:22:49.132445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:22:49.132446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:22:49.132929 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:22:49.133082 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 15:22:49.133501 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 15:22:49.133796 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":95,"threads_started":1}
W20260807 15:22:49.136734 6748 leader_election.cc:341] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259): Not found: Tablet not found: fb820952773841a795c95db83759359e
W20260807 15:22:49.137058 6748 leader_election.cc:341] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849): Not found: Tablet not found: fb820952773841a795c95db83759359e
I20260807 15:22:49.137133 6748 leader_election.cc:302] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b275f72c70aa43c89058510dc4ff461d; no voters: 1e8f867595c746c095627dadc82a5d6b, 7f8ed969d66a4d0f8338d7d4f99eeece
I20260807 15:22:49.137416 7326 raft_consensus.cc:2726] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:22:49.570941 7329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:49.570593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:53943)
0807 15:22:49.570796 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:49.570852 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 15:22:49.720922 7331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:49.720384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:43995)
0807 15:22:49.720687 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:49.720747 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":93,"threads_started":1}
I20260807 15:22:49.940972 7332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:49.940468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:46165)
0807 15:22:49.940746 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:49.940872 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":78,"threads_started":1}
I20260807 15:22:50.572391 7333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:50.571915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:45027)
0807 15:22:50.572211 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:50.572279 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":84,"threads_started":1}
I20260807 15:22:50.722314 7334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:50.721796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:41875)
0807 15:22:50.722130 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:50.722215 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":99,"threads_started":1}
I20260807 15:22:50.942288 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:50.941840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:48813)
0807 15:22:50.942110 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:50.942170 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":80,"threads_started":1}
I20260807 15:22:50.996562 7336 raft_consensus.cc:482] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:22:50.996816 7336 raft_consensus.cc:504] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:50.997370 7336 leader_election.cc:288] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849), 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259)
W20260807 15:22:50.998617 6748 leader_election.cc:341] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259): Not found: Tablet not found: fb820952773841a795c95db83759359e
W20260807 15:22:50.998809 6748 leader_election.cc:341] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849): Not found: Tablet not found: fb820952773841a795c95db83759359e
I20260807 15:22:50.998878 6748 leader_election.cc:302] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b275f72c70aa43c89058510dc4ff461d; no voters: 1e8f867595c746c095627dadc82a5d6b, 7f8ed969d66a4d0f8338d7d4f99eeece
I20260807 15:22:50.999131 7336 raft_consensus.cc:2726] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:22:51.573798 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:51.573300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:49571)
0807 15:22:51.573591 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:51.573650 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":90,"threads_started":1}
I20260807 15:22:51.723805 7341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:51.723270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:60787)
0807 15:22:51.723579 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:51.723650 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":87,"threads_started":1}
I20260807 15:22:51.943874 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:51.943370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:49619)
0807 15:22:51.943698 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:51.943767 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":95,"threads_started":1}
I20260807 15:22:52.575393 7344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:52.574879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:43743)
0807 15:22:52.575219 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:52.575286 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":83,"threads_started":1}
I20260807 15:22:52.725201 7345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:52.724680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:33117)
0807 15:22:52.725029 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:52.725091 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":109,"threads_started":1}
I20260807 15:22:52.945334 7348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:52.944877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:53191)
0807 15:22:52.945153 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:52.945227 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":82,"threads_started":1}
I20260807 15:22:53.577030 7349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:53.576479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:60691)
0807 15:22:53.576854 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:53.576922 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":130,"threads_started":1}
I20260807 15:22:53.599956 7350 raft_consensus.cc:482] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:22:53.600100 7350 raft_consensus.cc:504] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:53.600519 7350 leader_election.cc:288] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849), 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259)
W20260807 15:22:53.601508 6748 leader_election.cc:341] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849): Not found: Tablet not found: fb820952773841a795c95db83759359e
W20260807 15:22:53.601667 6748 leader_election.cc:341] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259): Not found: Tablet not found: fb820952773841a795c95db83759359e
I20260807 15:22:53.601743 6748 leader_election.cc:302] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b275f72c70aa43c89058510dc4ff461d; no voters: 1e8f867595c746c095627dadc82a5d6b, 7f8ed969d66a4d0f8338d7d4f99eeece
I20260807 15:22:53.601926 7350 raft_consensus.cc:2726] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:22:53.726886 7351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:53.726272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:52721)
0807 15:22:53.726689 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:53.726782 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":92,"threads_started":1}
I20260807 15:22:53.946743 7352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:53.946232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:48707)
0807 15:22:53.946537 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:53.946599 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":99,"threads_started":1}
I20260807 15:22:54.578464 7354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:54.577980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:58325)
0807 15:22:54.578288 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:54.578362 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":95,"threads_started":1}
I20260807 15:22:54.728394 7356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:54.727865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:53809)
0807 15:22:54.728205 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:54.728291 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":84,"threads_started":1}
I20260807 15:22:54.948165 7357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:54.947654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:58473)
0807 15:22:54.947993 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:54.948051 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":78,"threads_started":1}
I20260807 15:22:55.579959 7358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:55.579455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:40945)
0807 15:22:55.579798 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:55.579858 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":161,"threads_started":1}
I20260807 15:22:55.729792 7359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:55.729312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:44621)
0807 15:22:55.729584 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:55.729691 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":73,"threads_started":1}
I20260807 15:22:55.949618 7363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:55.949171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:33369)
0807 15:22:55.949457 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:55.949519 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":97,"threads_started":1}
I20260807 15:22:56.581383 7364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:56.580911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:54157)
0807 15:22:56.581212 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:56.581280 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":81,"threads_started":1}
I20260807 15:22:56.731256 7365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:56.730790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:57249)
0807 15:22:56.731085 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:56.731153 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":96,"threads_started":1}
I20260807 15:22:56.951236 7366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:56.950683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:33251)
0807 15:22:56.951026 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:56.951105 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":87,"threads_started":1}
I20260807 15:22:57.582926 7368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:57.582455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:41127)
0807 15:22:57.582761 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:57.582824 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":95,"threads_started":1}
I20260807 15:22:57.732586 7369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:57.732128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:48875)
0807 15:22:57.732412 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:57.732476 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":85,"threads_started":1}
I20260807 15:22:57.809335 7374 raft_consensus.cc:482] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:22:57.809496 7374 raft_consensus.cc:504] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8ed969d66a4d0f8338d7d4f99eeece" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44849 } } peers { permanent_uuid: "1e8f867595c746c095627dadc82a5d6b" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41259 } } peers { permanent_uuid: "b275f72c70aa43c89058510dc4ff461d" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 37197 } }
I20260807 15:22:57.810091 7374 leader_election.cc:288] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849), 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259)
W20260807 15:22:57.811129 6748 leader_election.cc:341] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1e8f867595c746c095627dadc82a5d6b (127.15.242.194:41259): Not found: Tablet not found: fb820952773841a795c95db83759359e
W20260807 15:22:57.811255 6748 leader_election.cc:341] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f8ed969d66a4d0f8338d7d4f99eeece (127.15.242.195:44849): Not found: Tablet not found: fb820952773841a795c95db83759359e
I20260807 15:22:57.811378 6748 leader_election.cc:302] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b275f72c70aa43c89058510dc4ff461d; no voters: 1e8f867595c746c095627dadc82a5d6b, 7f8ed969d66a4d0f8338d7d4f99eeece
I20260807 15:22:57.811596 7374 raft_consensus.cc:2726] T fb820952773841a795c95db83759359e P b275f72c70aa43c89058510dc4ff461d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:22:57.952865 7377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:57.952228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:51945)
0807 15:22:57.952560 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:57.952644 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":104,"threads_started":1}
I20260807 15:22:58.584259 7379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:58.583775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:42561)
0807 15:22:58.584071 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:58.584152 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":80,"threads_started":1}
I20260807 15:22:58.734043 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:58.733572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:59737)
0807 15:22:58.733862 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:58.733934 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":118,"threads_started":1}
I20260807 15:22:58.954296 7381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:58.953798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:57369)
0807 15:22:58.954121 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:58.954193 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":103,"threads_started":1}
I20260807 15:22:59.585543 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:59.585073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:45823)
0807 15:22:59.585366 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:59.585429 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":84,"threads_started":1}
I20260807 15:22:59.735353 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:59.734876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:42889)
0807 15:22:59.735143 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:59.735252 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":98,"threads_started":1}
I20260807 15:22:59.955672 7386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:22:59.955241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:54175)
0807 15:22:59.955496 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 15:22:59.955553 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":81,"threads_started":1}
I20260807 15:23:00.587011 7387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:00.586528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:43757)
0807 15:23:00.586837 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:00.586908 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":101,"threads_started":1}
I20260807 15:23:00.736593 7388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:00.736148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:39509)
0807 15:23:00.736434 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:00.736495 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":90,"threads_started":1}
I20260807 15:23:00.957278 7391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:00.956803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:36425)
0807 15:23:00.957107 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:00.957173 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":82,"threads_started":1}
I20260807 15:23:01.588414 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:01.587931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:43917)
0807 15:23:01.588252 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:01.588314 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":105,"threads_started":1}
I20260807 15:23:01.737923 7394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:01.737443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:43081)
0807 15:23:01.737759 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:01.737821 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":98,"threads_started":1}
I20260807 15:23:01.958703 7395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:01.958178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:45069)
0807 15:23:01.958507 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:01.958575 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":92,"threads_started":1}
I20260807 15:23:02.590025 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:02.589484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.193:35959)
0807 15:23:02.589841 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:02.589922 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":166,"threads_started":1}
I20260807 15:23:02.739605 7398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:02.739073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.194:43455)
0807 15:23:02.739415 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:02.739490 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":98,"threads_started":1}
I20260807 15:23:02.942770 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 6663
I20260807 15:23:02.958803 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 6923
I20260807 15:23:02.972712 7399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:02.972248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:38459 (local address 127.15.242.195:52761)
0807 15:23:02.972526 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:02.972601 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:38459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":102,"threads_started":1}
I20260807 15:23:02.978227 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 7127
2026-08-07T15:23:02Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19775 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:23:03 dist-test-slave-g170 krb5kdc[7402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:23:03 dist-test-slave-g170 krb5kdc[7402](info): set up 2 sockets
Aug 07 15:23:03 dist-test-slave-g170 krb5kdc[7402](info): commencing operation
krb5kdc: starting...
W20260807 15:23:04.347208 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.004s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:23:04 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:23:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:23:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:23:04.482513 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39455
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:39455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:23:04.608776 7422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:04.609130 7422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:04.609213 7422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:04.613412 7422 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 15:23:04.613500 7422 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 15:23:04.613528 7422 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 15:23:04.613554 7422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:23:04.613618 7422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:04.613691 7422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:04.613734 7422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:23:04.613768 7422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:23:04.619303 7422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:39455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:04.620504 7422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:04.621708 7422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:23:04.631062 7422 server_base.cc:1034] running on GCE node
W20260807 15:23:04.631036 7427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:04.631040 7433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:04.631104 7430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:04.632032 7422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:04.633297 7422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:04.634477 7422 hybrid_clock.cc:648] HybridClock initialized: now 1786116184634458 us; error 31 us; skew 500 ppm
Aug 07 15:23:04 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116184, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:04.637575 7422 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:23:04.638521 7422 webserver.cc:460] Webserver started at http://127.15.242.254:44075/ using document root <none> and password file <none>
I20260807 15:23:04.639106 7422 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:04.639240 7422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:04.639483 7422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:23:04.641652 7422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "62e463af9275423e87e9ed4210d8e054"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "e7280f726e32b05b464cf498c2b7a4bd"
server_key_iv: "4f66c23d48b9c70504528d024cbda0ce"
server_key_version: "encryptionkey@0"
I20260807 15:23:04.642239 7422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "62e463af9275423e87e9ed4210d8e054"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "e7280f726e32b05b464cf498c2b7a4bd"
server_key_iv: "4f66c23d48b9c70504528d024cbda0ce"
server_key_version: "encryptionkey@0"
I20260807 15:23:04.646040 7422 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:23:04.648581 7447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:04.649909 7422 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:23:04.650054 7422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "62e463af9275423e87e9ed4210d8e054"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "e7280f726e32b05b464cf498c2b7a4bd"
server_key_iv: "4f66c23d48b9c70504528d024cbda0ce"
server_key_version: "encryptionkey@0"
I20260807 15:23:04.650169 7422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:04.668756 7422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:04.672940 7422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:04.673184 7422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:04.682233 7422 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:39455
I20260807 15:23:04.682565 7523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:39455 every 8 connection(s)
I20260807 15:23:04.683504 7422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:23:04.686849 7524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:23:04.691220 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 7422
I20260807 15:23:04.691327 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:23:04.691635 16331 external_mini_cluster.cc:1428] Setting key cd02255844189a716c66deb2e89d8e97
I20260807 15:23:04.693383 7524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Bootstrap starting.
I20260807 15:23:04.696142 7524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Neither blocks nor log segments found. Creating new log.
I20260807 15:23:04.697043 7524 log.cc:824] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:04.699762 7524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: No bootstrap required, opened a new log
Aug 07 15:23:04 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:23:04.705089 7524 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:04.705408 7524 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:23:04.705495 7524 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62e463af9275423e87e9ed4210d8e054, State: Initialized, Role: FOLLOWER
I20260807 15:23:04.706079 7524 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:04.706261 7524 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:23:04.706357 7524 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:23:04.706470 7524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:23:04.707795 7524 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:04.708222 7524 leader_election.cc:302] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62e463af9275423e87e9ed4210d8e054; no voters:
I20260807 15:23:04.708662 7524 leader_election.cc:288] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:23:04.708802 7532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:23:04.709092 7532 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 1 LEADER]: Becoming Leader. State: Replica: 62e463af9275423e87e9ed4210d8e054, State: Running, Role: LEADER
I20260807 15:23:04.709615 7532 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:04.709935 7530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:04.693158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40436 (local address 127.15.242.254:39455)
0807 15:23:04.693588 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:04.693604 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:04.693647 (+ 43us) server_negotiation.cc:407] Connection header received
0807 15:23:04.694281 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:04.694298 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:04.694626 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:04.694918 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:04.696010 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:04.697224 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:04.698411 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:04.699283 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:04.699502 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:04.703476 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:04.703487 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:04.703512 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:04.703561 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:04.705947 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:04.706660 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:04.706667 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:04.706675 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:04.706833 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:04.707211 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:04.707215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:04.707217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:04.707830 (+ 613us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:04.708054 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:04.708377 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 15:23:04.708719 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":128,"threads_started":1}
I20260807 15:23:04.710129 7524 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:23:04.713251 7533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62e463af9275423e87e9ed4210d8e054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } } }
I20260807 15:23:04.713359 7534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62e463af9275423e87e9ed4210d8e054. Latest consensus state: current_term: 1 leader_uuid: "62e463af9275423e87e9ed4210d8e054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } } }
I20260807 15:23:04.713488 7534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: This master's current role is: LEADER
I20260807 15:23:04.713488 7533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: This master's current role is: LEADER
W20260807 15:23:04.715996 7552 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:23:04.716102 7552 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:23:04.716205 7555 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:23:04.717396 7555 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:23:04.724043 7555 catalog_manager.cc:1347] Generated new cluster ID: 9c0a137dc995434eb151f7770b23046c
I20260807 15:23:04.724146 7555 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:23:04.729957 7555 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:23:04.731190 7555 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:23:04.736874 7555 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Generated new TSK 0
I20260807 15:23:04.737686 7555 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:23:04.772032 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39455
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:23:04.894675 7562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:04.895005 7562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:04.895093 7562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:04.899313 7562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:04.899426 7562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:04.899529 7562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:23:04.904853 7562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:04.906026 7562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:04.907119 7562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:04.917832 7572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:04.917874 7562 server_base.cc:1034] running on GCE node
W20260807 15:23:04.917817 7568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:04.917850 7569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:04.918526 7562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:04.919380 7562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:04.920550 7562 hybrid_clock.cc:648] HybridClock initialized: now 1786116184920533 us; error 31 us; skew 500 ppm
Aug 07 15:23:04 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116184, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:04.923550 7562 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:23:04.924499 7562 webserver.cc:460] Webserver started at http://127.15.242.193:44869/ using document root <none> and password file <none>
I20260807 15:23:04.925284 7562 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:04.925382 7562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:04.925637 7562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:23:04.927700 7562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "e327b51620884c2aa9b2d6bb8b3d2668"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "0cea3a3e5310a9308a0d9cdc12026284"
server_key_iv: "47ad113e1bfc28bc705032f3a1b901ba"
server_key_version: "encryptionkey@0"
I20260807 15:23:04.928241 7562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "e327b51620884c2aa9b2d6bb8b3d2668"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "0cea3a3e5310a9308a0d9cdc12026284"
server_key_iv: "47ad113e1bfc28bc705032f3a1b901ba"
server_key_version: "encryptionkey@0"
I20260807 15:23:04.932104 7562 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:23:04.934793 7584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:04.936159 7562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 15:23:04.936307 7562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "e327b51620884c2aa9b2d6bb8b3d2668"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "0cea3a3e5310a9308a0d9cdc12026284"
server_key_iv: "47ad113e1bfc28bc705032f3a1b901ba"
server_key_version: "encryptionkey@0"
I20260807 15:23:04.936436 7562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:04.964109 7562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:04.968318 7562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:04.968549 7562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:04.969267 7562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:04.970222 7562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:23:04.970274 7562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:04.970321 7562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:23:04.970337 7562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:04.979992 7562 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:42971
I20260807 15:23:04.980013 7759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:42971 every 8 connection(s)
I20260807 15:23:04.981063 7562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:23:04.990538 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 7562
I20260807 15:23:04.990693 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:23:04.991006 16331 external_mini_cluster.cc:1428] Setting key 26c01014793a831aa027b6f6382848ae
Aug 07 15:23:04 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116184, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:23:04.996266 7530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:04.983014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:54167 (local address 127.15.242.254:39455)
0807 15:23:04.983163 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:04.983167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:04.984041 (+ 874us) server_negotiation.cc:407] Connection header received
0807 15:23:04.985510 (+ 1469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:04.985513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:04.985565 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:04.985645 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:04.986944 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:04.987485 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:04.988688 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:04.988989 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:04.989072 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:04.991688 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:04.991692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:04.991695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:04.991724 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:04.993397 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:04.994159 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:04.994163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:04.994164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:04.994280 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:04.994788 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:04.994791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:04.994793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:04.995132 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:04.995287 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:04.995819 (+ 532us) server_negotiation.cc:299] Negotiation successful
0807 15:23:04.995991 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 15:23:04.997087 7765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:04.983382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:54167)
0807 15:23:04.983865 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:04.983909 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:04.985297 (+ 1388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:04.985877 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:04.985884 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:04.986286 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:04.986801 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:04.986816 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:04.987622 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:04.987625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:04.988575 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:04.988586 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:04.989133 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:04.989136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:04.989285 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:04.989845 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:04.989861 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:04.991515 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:04.993524 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:04.993533 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:04.993553 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:04.994022 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:04.994390 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:04.994395 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:04.994400 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:04.994608 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:04.995290 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:04.995296 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:04.995553 (+ 257us) client_negotiation.cc:769] Sending connection context
0807 15:23:04.995771 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 15:23:04.996056 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":112,"threads_started":1}
I20260807 15:23:04.998530 7760 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39455
I20260807 15:23:04.998889 7760 heartbeater.cc:464] Registering TS with master...
I20260807 15:23:04.999423 7760 heartbeater.cc:511] Master 127.15.242.254:39455 requested a full tablet report, sending...
I20260807 15:23:05.001510 7475 ts_manager.cc:194] Registered new tserver with Master: e327b51620884c2aa9b2d6bb8b3d2668 (127.15.242.193:42971)
I20260807 15:23:05.003413 7475 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:54167
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:23:05.026515 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39455
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:23:05.146114 7770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:05.146469 7770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:05.146548 7770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:05.150723 7770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:05.150827 7770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:05.150944 7770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:23:05.157212 7770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:05.158468 7770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:05.159579 7770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:05.169808 7782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:05.169862 7775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:05.169802 7779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:05.170241 7770 server_base.cc:1034] running on GCE node
I20260807 15:23:05.170694 7770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:05.171403 7770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:05.172619 7770 hybrid_clock.cc:648] HybridClock initialized: now 1786116185172600 us; error 36 us; skew 500 ppm
Aug 07 15:23:05 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116185, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:05.175668 7770 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:23:05.176599 7770 webserver.cc:460] Webserver started at http://127.15.242.194:39287/ using document root <none> and password file <none>
I20260807 15:23:05.177309 7770 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:05.177407 7770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:05.177660 7770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:23:05.179716 7770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "3572868ad79e47889c60347ea7ec9af3"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "c1029632acf56ef99c4d7013d3274607"
server_key_iv: "b89a4d3773f092fa80cf57e280455acd"
server_key_version: "encryptionkey@0"
I20260807 15:23:05.180296 7770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "3572868ad79e47889c60347ea7ec9af3"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "c1029632acf56ef99c4d7013d3274607"
server_key_iv: "b89a4d3773f092fa80cf57e280455acd"
server_key_version: "encryptionkey@0"
I20260807 15:23:05.184201 7770 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:23:05.186770 7794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:05.188149 7770 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:23:05.188318 7770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "3572868ad79e47889c60347ea7ec9af3"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "c1029632acf56ef99c4d7013d3274607"
server_key_iv: "b89a4d3773f092fa80cf57e280455acd"
server_key_version: "encryptionkey@0"
I20260807 15:23:05.188455 7770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:05.199991 7770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:05.203258 7770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:05.203485 7770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:05.204075 7770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:05.204982 7770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:23:05.205053 7770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:05.205124 7770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:23:05.205176 7770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:05.215579 7770 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:40679
I20260807 15:23:05.215631 7962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:40679 every 8 connection(s)
I20260807 15:23:05.216498 7770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:23:05.224923 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 7770
I20260807 15:23:05.225149 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:23:05.225696 16331 external_mini_cluster.cc:1428] Setting key eb28bc1886df44d3b6675a39f90d6c2d
Aug 07 15:23:05 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116185, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:23:05.231600 7530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.218506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:49047 (local address 127.15.242.254:39455)
0807 15:23:05.218721 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.218725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.219538 (+ 813us) server_negotiation.cc:407] Connection header received
0807 15:23:05.220989 (+ 1451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.220993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.221053 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.221157 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:05.222339 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.222879 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.224042 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.224278 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.224394 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.227477 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:05.227480 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:05.227482 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:05.227507 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:05.229256 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:05.229911 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:05.229917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:05.229918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:05.230023 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:05.230384 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:05.230390 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:05.230394 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:05.230649 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:05.230764 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.231371 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.231480 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260807 15:23:05.232919 7966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.218905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:49047)
0807 15:23:05.219374 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:05.219417 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:05.220709 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:05.221348 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:05.221354 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:05.221713 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:05.222184 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.222196 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.223017 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.223021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.223909 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.223919 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.224436 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.224440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.224670 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.225449 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:05.225476 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:05.227276 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:05.229384 (+ 2108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:05.229395 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:05.229413 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:05.229798 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:05.230133 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:05.230135 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:05.230136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:05.230281 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:05.230786 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:05.230791 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:05.231057 (+ 266us) client_negotiation.cc:769] Sending connection context
0807 15:23:05.231317 (+ 260us) client_negotiation.cc:240] Negotiation successful
0807 15:23:05.231690 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":105,"threads_started":1}
I20260807 15:23:05.234380 7963 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39455
I20260807 15:23:05.234712 7963 heartbeater.cc:464] Registering TS with master...
I20260807 15:23:05.235392 7963 heartbeater.cc:511] Master 127.15.242.254:39455 requested a full tablet report, sending...
I20260807 15:23:05.236846 7475 ts_manager.cc:194] Registered new tserver with Master: 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679)
I20260807 15:23:05.237457 7475 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:49047
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:23:05.259522 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39455
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:23:05.376564 7971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:05.376888 7971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:05.376940 7971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:05.380839 7971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:05.380892 7971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:05.380947 7971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:23:05.386842 7971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:05.387852 7971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:05.388831 7971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:23:05.398839 7971 server_base.cc:1034] running on GCE node
W20260807 15:23:05.398777 7979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:05.398798 7982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:05.398787 7978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:05.399466 7971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:05.400106 7971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:05.401275 7971 hybrid_clock.cc:648] HybridClock initialized: now 1786116185401242 us; error 47 us; skew 500 ppm
Aug 07 15:23:05 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116185, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:05.404011 7971 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:23:05.405010 7971 webserver.cc:460] Webserver started at http://127.15.242.195:33743/ using document root <none> and password file <none>
I20260807 15:23:05.405543 7971 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:05.405601 7971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:05.405772 7971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:23:05.407765 7971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "b70d709bee174d85a5acb23bee8d99e9"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "5f9e72a105a5461b14422e48560b0d8b"
server_key_iv: "02a8b486b30a719ed263f02ade37fbb3"
server_key_version: "encryptionkey@0"
I20260807 15:23:05.408290 7971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "b70d709bee174d85a5acb23bee8d99e9"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "5f9e72a105a5461b14422e48560b0d8b"
server_key_iv: "02a8b486b30a719ed263f02ade37fbb3"
server_key_version: "encryptionkey@0"
I20260807 15:23:05.412352 7971 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:23:05.414909 7994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:05.416226 7971 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:23:05.416368 7971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "b70d709bee174d85a5acb23bee8d99e9"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "5f9e72a105a5461b14422e48560b0d8b"
server_key_iv: "02a8b486b30a719ed263f02ade37fbb3"
server_key_version: "encryptionkey@0"
I20260807 15:23:05.416486 7971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:05.443780 7971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:05.446954 7971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:05.447165 7971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:05.447765 7971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:05.448599 7971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:23:05.448670 7971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:05.448741 7971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:23:05.448835 7971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:05.459450 7971 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:42929
I20260807 15:23:05.459468 8166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:42929 every 8 connection(s)
I20260807 15:23:05.460434 7971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:23:05.467574 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 7971
I20260807 15:23:05.467803 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:23:05.468216 16331 external_mini_cluster.cc:1428] Setting key 75b4588b2f8f6c313e6804627c2127a1
Aug 07 15:23:05 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116185, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:23:05.475540 7530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.462443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:49943 (local address 127.15.242.254:39455)
0807 15:23:05.462610 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.462615 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.463570 (+ 955us) server_negotiation.cc:407] Connection header received
0807 15:23:05.465083 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.465086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.465142 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.465230 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:05.466521 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.467063 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.468652 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.468965 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.469067 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.472031 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:05.472034 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:05.472036 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:05.472061 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:05.473632 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:05.474110 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:05.474113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:05.474114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:05.474190 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:05.474513 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:05.474515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:05.474516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:05.474683 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:05.474759 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.475274 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.475393 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:23:05.476325 8169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.462865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:49943)
0807 15:23:05.463401 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:05.463444 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:05.464731 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:05.465405 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:05.465412 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:05.465833 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:05.466339 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.466353 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.467189 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.467192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.468491 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.468502 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.469114 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.469119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.469325 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.470065 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:05.470086 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:05.471877 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:05.473740 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:05.473745 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:05.473757 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:05.474010 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:05.474292 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:05.474295 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:05.474296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:05.474432 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:05.474780 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:05.474785 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:05.475015 (+ 230us) client_negotiation.cc:769] Sending connection context
0807 15:23:05.475181 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 15:23:05.475430 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":142,"threads_started":1}
I20260807 15:23:05.477568 8167 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39455
I20260807 15:23:05.477842 8167 heartbeater.cc:464] Registering TS with master...
I20260807 15:23:05.478377 8167 heartbeater.cc:511] Master 127.15.242.254:39455 requested a full tablet report, sending...
I20260807 15:23:05.479432 7475 ts_manager.cc:194] Registered new tserver with Master: b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929)
I20260807 15:23:05.480014 7475 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:49943
I20260807 15:23:05.482831 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:23:05.492645 7530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.484867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40452 (local address 127.15.242.254:39455)
0807 15:23:05.485009 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.485014 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.485236 (+ 222us) server_negotiation.cc:407] Connection header received
0807 15:23:05.485394 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.485399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.485444 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.485526 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:05.486227 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.486766 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.487633 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.487856 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.487964 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.489417 (+ 1453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:05.489421 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:05.489424 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:05.489455 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:05.490875 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:05.491306 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:05.491309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:05.491311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:05.491393 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:05.491681 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:05.491684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:05.491685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:05.491937 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:05.492102 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.492364 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.492483 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 15:23:05.495407 7475 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:23:05.498518 7475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:23:05.514297 8181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.507224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42929 (local address 127.0.0.1:59810)
0807 15:23:05.508062 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:05.508114 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:05.508248 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:05.509242 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:05.509245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:05.509257 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:05.509378 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.509385 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.510765 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.510771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.512615 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.512628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.513824 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.513827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.513946 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.514002 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 15:23:05.514072 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 15:23:05.514137 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"mutex_wait_us":154,"spinlock_wait_cycles":3328,"thread_start_us":82,"threads_started":1}
I20260807 15:23:05.514492 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.507995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60406 (local address 127.15.242.194:40679)
0807 15:23:05.508583 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.508603 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.508630 (+ 27us) server_negotiation.cc:407] Connection header received
0807 15:23:05.508721 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.508726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.508973 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.509162 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:05.509680 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.510863 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.512542 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.513462 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.513615 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.513757 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.513968 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.514085 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":127,"threads_started":1}
I20260807 15:23:05.514797 8186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.507494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36754 (local address 127.15.242.193:42971)
0807 15:23:05.508599 (+ 1105us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.508606 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.508629 (+ 23us) server_negotiation.cc:407] Connection header received
0807 15:23:05.508713 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.508719 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.508971 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.509539 (+ 568us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:05.509693 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.510863 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.512953 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.513598 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.513731 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.513874 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.514349 (+ 475us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.514638 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":969,"thread_start_us":100,"threads_started":1}
I20260807 15:23:05.514796 8185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.507386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59810 (local address 127.15.242.195:42929)
0807 15:23:05.508658 (+ 1272us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.508671 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.508691 (+ 20us) server_negotiation.cc:407] Connection header received
0807 15:23:05.508798 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.508804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.508971 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.509264 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:05.509511 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.510613 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.512750 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.513534 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.513640 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.513757 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.514543 (+ 786us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.514655 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1149,"thread_start_us":142,"threads_started":1}
I20260807 15:23:05.514258 8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.507399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:40679 (local address 127.0.0.1:60406)
0807 15:23:05.508062 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:05.508114 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:05.508248 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:05.509379 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:05.509383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:05.509406 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:05.509536 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.509543 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.511023 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.511029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.512387 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.512399 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.513613 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.513617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.513750 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.513791 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 15:23:05.513925 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 15:23:05.514057 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":39,"spinlock_wait_cycles":1408,"thread_start_us":127,"threads_started":1}
I20260807 15:23:05.514456 8183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.507224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:42971 (local address 127.0.0.1:36754)
0807 15:23:05.508156 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:05.508174 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:05.508290 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:05.509144 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:05.509151 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:05.509174 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:05.509378 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.509385 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.511039 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.511043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.512815 (+ 1772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.512830 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.513945 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.513949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.514063 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.514085 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 15:23:05.514176 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 15:23:05.514239 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":804,"thread_start_us":116,"threads_started":1}
I20260807 15:23:05.518514 8063 tablet_service.cc:1467] Processing CreateTablet for tablet b79d33296e7049cf9848fe6dcc5efb85 (DEFAULT_TABLE table=test-table [id=68256937117e467ebb722b19b35c0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:23:05.518518 7861 tablet_service.cc:1467] Processing CreateTablet for tablet b79d33296e7049cf9848fe6dcc5efb85 (DEFAULT_TABLE table=test-table [id=68256937117e467ebb722b19b35c0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:23:05.518786 7653 tablet_service.cc:1467] Processing CreateTablet for tablet b79d33296e7049cf9848fe6dcc5efb85 (DEFAULT_TABLE table=test-table [id=68256937117e467ebb722b19b35c0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:23:05.519610 8063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79d33296e7049cf9848fe6dcc5efb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:23:05.519632 7653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79d33296e7049cf9848fe6dcc5efb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:23:05.519644 7861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79d33296e7049cf9848fe6dcc5efb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:23:05.526413 8190 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Bootstrap starting.
I20260807 15:23:05.527612 8192 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Bootstrap starting.
I20260807 15:23:05.528913 8190 tablet_bootstrap.cc:654] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Neither blocks nor log segments found. Creating new log.
I20260807 15:23:05.529105 8191 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Bootstrap starting.
I20260807 15:23:05.530150 8192 tablet_bootstrap.cc:654] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Neither blocks nor log segments found. Creating new log.
I20260807 15:23:05.530244 8190 log.cc:824] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:05.531018 8192 log.cc:824] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:05.531407 8191 tablet_bootstrap.cc:654] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Neither blocks nor log segments found. Creating new log.
I20260807 15:23:05.532258 8191 log.cc:824] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:05.532580 8190 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: No bootstrap required, opened a new log
I20260807 15:23:05.532876 8190 ts_tablet_manager.cc:1397] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260807 15:23:05.533193 8192 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: No bootstrap required, opened a new log
I20260807 15:23:05.533393 8192 ts_tablet_manager.cc:1397] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:23:05.534343 8191 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: No bootstrap required, opened a new log
I20260807 15:23:05.534520 8191 ts_tablet_manager.cc:1397] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:23:05.536379 8190 raft_consensus.cc:348] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.536777 8190 raft_consensus.cc:374] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:23:05.536846 8190 raft_consensus.cc:729] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b70d709bee174d85a5acb23bee8d99e9, State: Initialized, Role: FOLLOWER
I20260807 15:23:05.537371 8190 consensus_queue.cc:260] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.537593 8192 raft_consensus.cc:348] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.537907 8192 raft_consensus.cc:374] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:23:05.537967 8192 raft_consensus.cc:729] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3572868ad79e47889c60347ea7ec9af3, State: Initialized, Role: FOLLOWER
I20260807 15:23:05.538419 8192 consensus_queue.cc:260] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.538554 8190 ts_tablet_manager.cc:1428] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:23:05.538946 8167 heartbeater.cc:503] Master 127.15.242.254:39455 was elected leader, sending a full tablet report...
I20260807 15:23:05.539342 7963 heartbeater.cc:503] Master 127.15.242.254:39455 was elected leader, sending a full tablet report...
I20260807 15:23:05.539255 8191 raft_consensus.cc:348] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.539520 8191 raft_consensus.cc:374] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:23:05.539569 8191 raft_consensus.cc:729] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e327b51620884c2aa9b2d6bb8b3d2668, State: Initialized, Role: FOLLOWER
I20260807 15:23:05.539983 8191 consensus_queue.cc:260] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.540426 8192 ts_tablet_manager.cc:1428] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:23:05.540940 8191 ts_tablet_manager.cc:1428] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260807 15:23:05.541332 7760 heartbeater.cc:503] Master 127.15.242.254:39455 was elected leader, sending a full tablet report...
I20260807 15:23:05.657128 8199 raft_consensus.cc:482] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:23:05.657388 8199 raft_consensus.cc:504] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.658850 8199 leader_election.cc:288] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929), e327b51620884c2aa9b2d6bb8b3d2668 (127.15.242.193:42971)
I20260807 15:23:05.664093 7966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.659135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42929 (local address 127.15.242.194:52063)
0807 15:23:05.659354 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:05.659371 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:05.659487 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:05.659837 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:05.659844 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:05.659865 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:05.660007 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.660013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.661140 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.661144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.662479 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.662492 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.663483 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.663487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.663721 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.663750 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 15:23:05.663824 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 15:23:05.663918 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":74}
I20260807 15:23:05.664110 8186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.659568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:33779 (local address 127.15.242.193:42971)
0807 15:23:05.659733 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.659741 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.659760 (+ 19us) server_negotiation.cc:407] Connection header received
0807 15:23:05.659956 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.659959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.660009 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.660073 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:05.660529 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.661231 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.662641 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.663315 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.663455 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.663512 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.663880 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.663974 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 15:23:05.664110 8185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.659289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:52063 (local address 127.15.242.195:42929)
0807 15:23:05.659427 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.659433 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.659447 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:23:05.659604 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.659607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.659658 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.659730 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:05.660177 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.660997 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.662642 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.663315 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.663455 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.663512 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.663880 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.663980 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:23:05.664103 8202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.659135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:42971 (local address 127.15.242.194:33779)
0807 15:23:05.659662 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:05.659679 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:05.659808 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:05.660131 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:05.660138 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:05.660165 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:05.660304 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.660316 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.661344 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.661348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.662492 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:05.662499 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.663483 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.663487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:05.663675 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.663705 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 15:23:05.663802 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 15:23:05.663910 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":92,"thread_start_us":158,"threads_started":1}
I20260807 15:23:05.664929 8094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79d33296e7049cf9848fe6dcc5efb85" candidate_uuid: "3572868ad79e47889c60347ea7ec9af3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b70d709bee174d85a5acb23bee8d99e9" is_pre_election: true
I20260807 15:23:05.665025 7689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79d33296e7049cf9848fe6dcc5efb85" candidate_uuid: "3572868ad79e47889c60347ea7ec9af3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" is_pre_election: true
I20260807 15:23:05.665308 7689 raft_consensus.cc:2454] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3572868ad79e47889c60347ea7ec9af3 in term 0.
I20260807 15:23:05.665308 8094 raft_consensus.cc:2454] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3572868ad79e47889c60347ea7ec9af3 in term 0.
I20260807 15:23:05.665998 7797 leader_election.cc:302] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3572868ad79e47889c60347ea7ec9af3, b70d709bee174d85a5acb23bee8d99e9, e327b51620884c2aa9b2d6bb8b3d2668; no voters:
I20260807 15:23:05.666378 8199 raft_consensus.cc:2781] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:23:05.666471 8199 raft_consensus.cc:482] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:23:05.666504 8199 raft_consensus.cc:3037] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:23:05.667603 8199 raft_consensus.cc:504] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.668119 8199 leader_election.cc:288] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [CANDIDATE]: Term 1 election: Requested vote from peers b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929), e327b51620884c2aa9b2d6bb8b3d2668 (127.15.242.193:42971)
I20260807 15:23:05.668681 8094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79d33296e7049cf9848fe6dcc5efb85" candidate_uuid: "3572868ad79e47889c60347ea7ec9af3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b70d709bee174d85a5acb23bee8d99e9"
I20260807 15:23:05.668859 8094 raft_consensus.cc:3037] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:23:05.668884 7689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79d33296e7049cf9848fe6dcc5efb85" candidate_uuid: "3572868ad79e47889c60347ea7ec9af3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e327b51620884c2aa9b2d6bb8b3d2668"
I20260807 15:23:05.669052 7689 raft_consensus.cc:3037] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:23:05.670040 8094 raft_consensus.cc:2454] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3572868ad79e47889c60347ea7ec9af3 in term 1.
I20260807 15:23:05.670401 7689 raft_consensus.cc:2454] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3572868ad79e47889c60347ea7ec9af3 in term 1.
I20260807 15:23:05.670416 7798 leader_election.cc:302] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3572868ad79e47889c60347ea7ec9af3, b70d709bee174d85a5acb23bee8d99e9; no voters:
I20260807 15:23:05.670639 8199 raft_consensus.cc:2781] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:23:05.670919 8199 raft_consensus.cc:686] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 1 LEADER]: Becoming Leader. State: Replica: 3572868ad79e47889c60347ea7ec9af3, State: Running, Role: LEADER
I20260807 15:23:05.671307 8199 consensus_queue.cc:237] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:05.675140 7472 catalog_manager.cc:5495] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "3572868ad79e47889c60347ea7ec9af3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } health_report { overall_health: HEALTHY } } }
I20260807 15:23:05.707581 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.702765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60408 (local address 127.15.242.194:40679)
0807 15:23:05.702921 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:05.702926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:05.702945 (+ 19us) server_negotiation.cc:407] Connection header received
0807 15:23:05.703145 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:05.703149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:05.703252 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:05.703387 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:23:05.703689 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.704550 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.705979 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:05.706204 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:05.706300 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:05.706634 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:23:05.707117 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:23:05.707219 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:05.707300 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 15:23:05.707358 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 15:23:05.711460 8168 tablet.cc:2369] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:23:05.714651 8094 raft_consensus.cc:1261] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 1 FOLLOWER]: Refusing update from remote peer 3572868ad79e47889c60347ea7ec9af3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:23:05.714617 7689 raft_consensus.cc:1261] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Refusing update from remote peer 3572868ad79e47889c60347ea7ec9af3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:23:05.715385 8199 consensus_queue.cc:1035] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:23:05.715610 8203 consensus_queue.cc:1035] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 15:23:05.717737 7965 tablet.cc:2369] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:23:05.723340 8207 mvcc.cc:205] Tried to move back new op lower bound from 7315931896678563840 to 7315931896512716800. Current Snapshot: MvccSnapshot[applied={T|T < 7315931896678563840}]
I20260807 15:23:05.724408 8213 mvcc.cc:205] Tried to move back new op lower bound from 7315931896678563840 to 7315931896512716800. Current Snapshot: MvccSnapshot[applied={T|T < 7315931896678563840}]
I20260807 15:23:05.726761 8210 mvcc.cc:205] Tried to move back new op lower bound from 7315931896678563840 to 7315931896512716800. Current Snapshot: MvccSnapshot[applied={T|T < 7315931896678563840}]
I20260807 15:23:05.734653 7475 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:23:05.734946 7475 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:23:05.737895 7475 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Sending DeleteTablet for 3 replicas of tablet b79d33296e7049cf9848fe6dcc5efb85
I20260807 15:23:05.738867 7861 tablet_service.cc:1514] Processing DeleteTablet for tablet b79d33296e7049cf9848fe6dcc5efb85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:23:05 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:60406
I20260807 15:23:05.738867 8063 tablet_service.cc:1514] Processing DeleteTablet for tablet b79d33296e7049cf9848fe6dcc5efb85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:23:05 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:59810
I20260807 15:23:05.738886 7653 tablet_service.cc:1514] Processing DeleteTablet for tablet b79d33296e7049cf9848fe6dcc5efb85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:23:05 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:36754
I20260807 15:23:05.739482 8226 tablet_replica.cc:330] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: stopping tablet replica
I20260807 15:23:05.739701 8225 tablet_replica.cc:330] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: stopping tablet replica
I20260807 15:23:05.739893 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 7562
I20260807 15:23:05.747195 8225 raft_consensus.cc:2229] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:23:05.748014 8225 raft_consensus.cc:2258] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:23:05.757431 8225 ts_tablet_manager.cc:1905] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:23:05.761332 8225 ts_tablet_manager.cc:1918] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:23:05.761564 8225 log.cc:1196] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/b79d33296e7049cf9848fe6dcc5efb85
I20260807 15:23:05.761987 8225 ts_tablet_manager.cc:1939] T b79d33296e7049cf9848fe6dcc5efb85 P 3572868ad79e47889c60347ea7ec9af3: Deleting consensus metadata
I20260807 15:23:05.763631 7448 catalog_manager.cc:4841] TS 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679): tablet b79d33296e7049cf9848fe6dcc5efb85 (table test-table [id=68256937117e467ebb722b19b35c0093]) successfully deleted
I20260807 15:23:05.739948 8226 raft_consensus.cc:2229] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:23:05.765074 8226 raft_consensus.cc:2258] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:23:05.766808 8226 ts_tablet_manager.cc:1905] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:23:05.769748 8226 ts_tablet_manager.cc:1918] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:23:05.769863 8226 log.cc:1196] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/b79d33296e7049cf9848fe6dcc5efb85
I20260807 15:23:05.770216 8226 ts_tablet_manager.cc:1939] T b79d33296e7049cf9848fe6dcc5efb85 P b70d709bee174d85a5acb23bee8d99e9: Deleting consensus metadata
W20260807 15:23:05.771405 7449 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:42971 (error 108)
I20260807 15:23:05.771759 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 7770
I20260807 15:23:05.771842 7450 catalog_manager.cc:4841] TS b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929): tablet b79d33296e7049cf9848fe6dcc5efb85 (table test-table [id=68256937117e467ebb722b19b35c0093]) successfully deleted
I20260807 15:23:05.778016 8181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:05.776852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:42971 (local address 127.0.0.1:36762)
0807 15:23:05.777851 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:05.777929 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:42971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":893}
W20260807 15:23:05.778254 7449 catalog_manager.cc:4584] TS e327b51620884c2aa9b2d6bb8b3d2668 (127.15.242.193:42971): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b79d33296e7049cf9848fe6dcc5efb85: Network error: Client connection negotiation failed: client connection to 127.15.242.193:42971: connect: Connection refused (error 111)
I20260807 15:23:05.786551 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 7971
I20260807 15:23:05.802273 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 7422
I20260807 15:23:25.820487 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39455
--webserver_interface=127.15.242.254
--webserver_port=44075
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:39455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:23:25.943423 8231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:25.943768 8231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:25.943816 8231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:25.948045 8231 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 15:23:25.948117 8231 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 15:23:25.948134 8231 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 15:23:25.948148 8231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:23:25.948166 8231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:25.948185 8231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:25.948200 8231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:23:25.948215 8231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:23:25.953739 8231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:39455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=44075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:25.955082 8231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:25.956382 8231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:25.973431 8245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:25.973433 8240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:25.973433 8242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:25.973803 8231 server_base.cc:1034] running on GCE node
I20260807 15:23:25.974603 8231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:25.976069 8231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:25.977346 8231 hybrid_clock.cc:648] HybridClock initialized: now 1786116205977292 us; error 60 us; skew 500 ppm
Aug 07 15:23:25 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116205, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:25.986739 8231 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:23:25.988041 8231 webserver.cc:460] Webserver started at http://127.15.242.254:44075/ using document root <none> and password file <none>
I20260807 15:23:25.988828 8231 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:25.988958 8231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:25.993847 8231 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 15:23:25.996507 8253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:25.998000 8231 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:23:25.998191 8231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "62e463af9275423e87e9ed4210d8e054"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "e7280f726e32b05b464cf498c2b7a4bd"
server_key_iv: "4f66c23d48b9c70504528d024cbda0ce"
server_key_version: "encryptionkey@0"
I20260807 15:23:25.998871 8231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:26.015480 8231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:26.019598 8231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:26.019869 8231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:26.028849 8231 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:39455
I20260807 15:23:26.029191 8342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:39455 every 8 connection(s)
I20260807 15:23:26.030308 8231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:23:26.035307 8343 sys_catalog.cc:263] Verifying existing consensus state
I20260807 15:23:26.037151 8343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Bootstrap starting.
I20260807 15:23:26.039798 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 8231
I20260807 15:23:26.040354 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:42971
--local_ip_for_outbound_sockets=127.15.242.193
--tserver_master_addrs=127.15.242.254:39455
--webserver_port=44869
--webserver_interface=127.15.242.193
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:23:26.056681 8343 log.cc:824] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:26.065968 8343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:23:26.066401 8343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Bootstrap complete.
I20260807 15:23:26.070847 8343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:26.071264 8343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62e463af9275423e87e9ed4210d8e054, State: Initialized, Role: FOLLOWER
I20260807 15:23:26.071784 8343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:26.071962 8343 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:23:26.072053 8343 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:23:26.072173 8343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 1 FOLLOWER]: Advancing to term 2
I20260807 15:23:26.074450 8343 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:26.074764 8343 leader_election.cc:302] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62e463af9275423e87e9ed4210d8e054; no voters:
I20260807 15:23:26.075076 8343 leader_election.cc:288] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 15:23:26.075172 8348 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 15:23:26.075384 8348 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 2 LEADER]: Becoming Leader. State: Replica: 62e463af9275423e87e9ed4210d8e054, State: Running, Role: LEADER
I20260807 15:23:26.075714 8348 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:26.076460 8343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:23:26.076813 8348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62e463af9275423e87e9ed4210d8e054. Latest consensus state: current_term: 2 leader_uuid: "62e463af9275423e87e9ed4210d8e054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } } }
I20260807 15:23:26.076953 8348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: This master's current role is: LEADER
I20260807 15:23:26.077445 8349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "62e463af9275423e87e9ed4210d8e054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } } }
I20260807 15:23:26.077657 8349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: This master's current role is: LEADER
I20260807 15:23:26.078927 8353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:23:26.084270 8353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:23:26.085032 8353 catalog_manager.cc:1259] Loaded cluster ID: 9c0a137dc995434eb151f7770b23046c
I20260807 15:23:26.085095 8353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:23:26.087934 8353 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:23:26.088838 8353 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Loaded TSK: 0
I20260807 15:23:26.103996 8353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Generated new TSK 1
I20260807 15:23:26.104306 8353 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 15:23:26.177811 8346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:26.178202 8346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:26.178299 8346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:26.183051 8346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:26.183116 8346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:26.183218 8346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:23:26.189494 8346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:42971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=44869
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:26.190728 8346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:26.191890 8346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:26.202498 8386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:26.202509 8390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:26.202486 8385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:26.203397 8346 server_base.cc:1034] running on GCE node
I20260807 15:23:26.203845 8346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:26.204559 8346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:26.205732 8346 hybrid_clock.cc:648] HybridClock initialized: now 1786116206205697 us; error 52 us; skew 500 ppm
Aug 07 15:23:26 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116206, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:26.209067 8346 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:23:26.210186 8346 webserver.cc:460] Webserver started at http://127.15.242.193:44869/ using document root <none> and password file <none>
I20260807 15:23:26.210937 8346 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:26.211059 8346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:26.216251 8346 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:23:26.218922 8402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:26.220392 8346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:23:26.220510 8346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "e327b51620884c2aa9b2d6bb8b3d2668"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "0cea3a3e5310a9308a0d9cdc12026284"
server_key_iv: "47ad113e1bfc28bc705032f3a1b901ba"
server_key_version: "encryptionkey@0"
I20260807 15:23:26.221213 8346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:26.242791 8346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:26.246747 8346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:26.246941 8346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:26.247654 8346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:26.248992 8410 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 15:23:26.253597 8346 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 15:23:26.253660 8346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260807 15:23:26.253777 8346 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 15:23:26.255522 8346 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 15:23:26.255568 8346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 15:23:26.255991 8410 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Bootstrap starting.
I20260807 15:23:26.266516 8346 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:42971
I20260807 15:23:26.266570 8590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:42971 every 8 connection(s)
I20260807 15:23:26.267494 8346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:23:26.273154 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 8346
I20260807 15:23:26.273865 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:40679
--local_ip_for_outbound_sockets=127.15.242.194
--tserver_master_addrs=127.15.242.254:39455
--webserver_port=39287
--webserver_interface=127.15.242.194
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:23:26.279639 8410 log.cc:824] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Log is configured to *not* fsync() on all Append() calls
Aug 07 15:23:26 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116206, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:23:26.290701 8597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.276245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:56087 (local address 127.15.242.254:39455)
0807 15:23:26.276740 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.276786 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.276839 (+ 53us) server_negotiation.cc:407] Connection header received
0807 15:23:26.277219 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.277240 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.277730 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.278149 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:26.279380 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.280725 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.282000 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.282582 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.282762 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.285485 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:26.285492 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:26.285514 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:26.285542 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:26.287329 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.287880 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.287887 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.287899 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.288070 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.288465 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.288468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.288470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.288890 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:26.289040 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.289586 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.289852 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":143,"threads_started":1}
I20260807 15:23:26.290728 8595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.269961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:56087)
0807 15:23:26.270604 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.270657 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:26.271594 (+ 937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:26.278254 (+ 6660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:26.278262 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:26.278726 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:26.279198 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.279215 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.280927 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.280931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.281860 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.281870 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.282800 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.282805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.283016 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.283698 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:26.283722 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:26.285285 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:26.287459 (+ 2174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:26.287465 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:26.287478 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:26.287754 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:26.288207 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:26.288211 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:26.288213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:26.288362 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:26.289011 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:26.289017 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:26.289270 (+ 253us) client_negotiation.cc:769] Sending connection context
0807 15:23:26.289453 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 15:23:26.289800 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":194,"threads_started":1}
I20260807 15:23:26.290795 8410 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:23:26.291627 8410 tablet_bootstrap.cc:492] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Bootstrap complete.
I20260807 15:23:26.293195 8410 ts_tablet_manager.cc:1397] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Time spent bootstrapping tablet: real 0.037s user 0.025s sys 0.011s
I20260807 15:23:26.293668 8591 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39455
I20260807 15:23:26.293905 8591 heartbeater.cc:464] Registering TS with master...
I20260807 15:23:26.294461 8591 heartbeater.cc:511] Master 127.15.242.254:39455 requested a full tablet report, sending...
I20260807 15:23:26.295415 8410 raft_consensus.cc:348] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:26.295801 8410 raft_consensus.cc:729] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e327b51620884c2aa9b2d6bb8b3d2668, State: Initialized, Role: FOLLOWER
I20260807 15:23:26.296316 8410 consensus_queue.cc:260] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } } peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } }
I20260807 15:23:26.297328 8410 ts_tablet_manager.cc:1428] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260807 15:23:26.297555 8278 ts_manager.cc:194] Registered new tserver with Master: e327b51620884c2aa9b2d6bb8b3d2668 (127.15.242.193:42971)
I20260807 15:23:26.301999 8278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:56087
I20260807 15:23:26.304566 8591 heartbeater.cc:503] Master 127.15.242.254:39455 was elected leader, sending a full tablet report...
Aug 07 15:23:26 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116205, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.193@KRBTEST.COM
I20260807 15:23:26.312294 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.301194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:42971 (local address 127.0.0.1:59618)
0807 15:23:26.301918 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.301952 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:26.302111 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:26.302664 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:26.302671 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:26.303260 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:26.303416 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.303426 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.305084 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.305088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.305738 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.305748 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.306408 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.306412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.306531 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.307134 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:26.307146 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:26.308480 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:26.310472 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:26.310482 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:26.310488 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:26.310735 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:26.311054 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:26.311058 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:26.311060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:26.311149 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:26.311617 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:26.311623 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:26.311756 (+ 133us) client_negotiation.cc:769] Sending connection context
0807 15:23:26.311899 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 15:23:26.312100 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":123,"threads_started":1}
I20260807 15:23:26.312311 8604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.301291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.15.242.193:42971)
0807 15:23:26.301681 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.301692 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.302048 (+ 356us) server_negotiation.cc:407] Connection header received
0807 15:23:26.302254 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.302262 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.302496 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.302637 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:26.303593 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.304951 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.305867 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.306294 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.306402 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.308621 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:26.308631 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:26.308644 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:26.308674 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:26.310354 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.310861 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.310867 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.310869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.310959 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.311249 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.311252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.311254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.311496 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:26.311641 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.311985 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.312148 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":95,"threads_started":1}
I20260807 15:23:26.313376 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet b79d33296e7049cf9848fe6dcc5efb85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:23:05 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:59618
I20260807 15:23:26.314263 8605 tablet_replica.cc:330] stopping tablet replica
I20260807 15:23:26.314621 8605 raft_consensus.cc:2229] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:23:26.314919 8605 raft_consensus.cc:2258] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:23:26.316128 8605 ts_tablet_manager.cc:1905] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:23:26.320948 8605 ts_tablet_manager.cc:1918] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:23:26.321056 8605 log.cc:1196] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal/wals/b79d33296e7049cf9848fe6dcc5efb85
I20260807 15:23:26.321373 8605 ts_tablet_manager.cc:1939] T b79d33296e7049cf9848fe6dcc5efb85 P e327b51620884c2aa9b2d6bb8b3d2668: Deleting consensus metadata
I20260807 15:23:26.323545 8255 catalog_manager.cc:4841] TS e327b51620884c2aa9b2d6bb8b3d2668 (127.15.242.193:42971): tablet b79d33296e7049cf9848fe6dcc5efb85 (table test-table [id=68256937117e467ebb722b19b35c0093]) successfully deleted
W20260807 15:23:26.415886 8596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:26.416157 8596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:26.416230 8596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:26.420678 8596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:26.420737 8596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:26.420881 8596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:23:26.426981 8596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:40679
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=39287
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:26.428050 8596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:26.429210 8596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:26.439667 8611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:26.439821 8596 server_base.cc:1034] running on GCE node
W20260807 15:23:26.439693 8617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:26.440032 8612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:26.440516 8596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:26.441290 8596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:26.442476 8596 hybrid_clock.cc:648] HybridClock initialized: now 1786116206442458 us; error 28 us; skew 500 ppm
Aug 07 15:23:26 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116206, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:26.445569 8596 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:23:26.446467 8596 webserver.cc:460] Webserver started at http://127.15.242.194:39287/ using document root <none> and password file <none>
I20260807 15:23:26.447024 8596 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:26.447099 8596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:26.451553 8596 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 15:23:26.454092 8628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:26.455682 8596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:23:26.455821 8596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "3572868ad79e47889c60347ea7ec9af3"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "c1029632acf56ef99c4d7013d3274607"
server_key_iv: "b89a4d3773f092fa80cf57e280455acd"
server_key_version: "encryptionkey@0"
I20260807 15:23:26.456421 8596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:26.476699 8596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:26.481063 8596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:26.481304 8596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:26.482028 8596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:26.482990 8596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:23:26.483070 8596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:26.483148 8596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:23:26.483202 8596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:26.493785 8596 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:40679
I20260807 15:23:26.493844 8806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:40679 every 8 connection(s)
I20260807 15:23:26.494963 8596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:23:26.496397 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 8596
I20260807 15:23:26.496969 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:42929
--local_ip_for_outbound_sockets=127.15.242.195
--tserver_master_addrs=127.15.242.254:39455
--webserver_port=33743
--webserver_interface=127.15.242.195
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 15:23:26 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116206, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:23:26.513592 8597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.497528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:41029 (local address 127.15.242.254:39455)
0807 15:23:26.497732 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.497739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.498880 (+ 1141us) server_negotiation.cc:407] Connection header received
0807 15:23:26.500460 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.500463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.500533 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.500647 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:26.502566 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.503452 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.505599 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.505926 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.506025 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.509559 (+ 3534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:26.509562 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:26.509565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:26.509593 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:26.511217 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.511812 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.511815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.511816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.511898 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.512289 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.512293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.512295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.512493 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:26.512605 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.513252 (+ 647us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.513409 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 15:23:26.514520 8809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.498017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:41029)
0807 15:23:26.498657 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.498733 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:26.500226 (+ 1493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:26.500918 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:26.500931 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:26.501525 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:26.502347 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.502374 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.503617 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.503623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.505405 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.505423 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.506121 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.506127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.506404 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.507153 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:26.507180 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:26.509346 (+ 2166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:26.511353 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:26.511360 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:26.511379 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:26.511684 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:26.512009 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:26.512013 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:26.512015 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:26.512179 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:26.512610 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:26.512634 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:26.512987 (+ 353us) client_negotiation.cc:769] Sending connection context
0807 15:23:26.513193 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 15:23:26.513611 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":130,"threads_started":1}
I20260807 15:23:26.515988 8807 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39455
I20260807 15:23:26.516299 8807 heartbeater.cc:464] Registering TS with master...
I20260807 15:23:26.516932 8807 heartbeater.cc:511] Master 127.15.242.254:39455 requested a full tablet report, sending...
I20260807 15:23:26.518091 8278 ts_manager.cc:194] Registered new tserver with Master: 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679)
I20260807 15:23:26.518764 8278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:41029
W20260807 15:23:26.619634 8810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:26.619944 8810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:26.620029 8810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:26.624171 8810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:26.624274 8810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:26.624367 8810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:23:26.629921 8810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:42929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=33743
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:26.631026 8810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:26.632092 8810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:26.642750 8821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:26.642814 8810 server_base.cc:1034] running on GCE node
W20260807 15:23:26.642732 8820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:26.642727 8824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:26.643467 8810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:26.644227 8810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:26.645493 8810 hybrid_clock.cc:648] HybridClock initialized: now 1786116206645474 us; error 31 us; skew 500 ppm
Aug 07 15:23:26 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116206, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:26.648643 8810 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:23:26.649669 8810 webserver.cc:460] Webserver started at http://127.15.242.195:33743/ using document root <none> and password file <none>
I20260807 15:23:26.650295 8810 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:26.650418 8810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:26.654428 8810 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 15:23:26.656859 8835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:26.658356 8810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:23:26.658515 8810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "b70d709bee174d85a5acb23bee8d99e9"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "5f9e72a105a5461b14422e48560b0d8b"
server_key_iv: "02a8b486b30a719ed263f02ade37fbb3"
server_key_version: "encryptionkey@0"
I20260807 15:23:26.659157 8810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:26.689822 8810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:26.693888 8810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:26.694159 8810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:26.694989 8810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:26.696007 8810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:23:26.696111 8810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:26.696229 8810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:23:26.696296 8810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:26.707361 8810 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:42929
I20260807 15:23:26.707449 9007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:42929 every 8 connection(s)
I20260807 15:23:26.708600 8810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:23:26.716941 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 8810
Aug 07 15:23:26 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116206, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:23:26.726575 8597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.710785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:57769 (local address 127.15.242.254:39455)
0807 15:23:26.711105 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.711109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.711931 (+ 822us) server_negotiation.cc:407] Connection header received
0807 15:23:26.713401 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.713404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.713455 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.713541 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:26.715153 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.715780 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.717829 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.718174 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.718306 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.721742 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:26.721745 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:26.721748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:26.721780 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:26.723668 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.724245 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.724252 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.724257 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.724355 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.724864 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.724867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.724868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.725129 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:26.725233 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.726228 (+ 995us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.726366 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220}
I20260807 15:23:26.727872 9011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.711183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:57769)
0807 15:23:26.711762 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.711810 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:26.713169 (+ 1359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:26.713877 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:26.713885 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:26.714275 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:26.714972 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.714988 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.715970 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.715974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.717665 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.717691 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.718383 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.718392 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.718670 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.719436 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:26.719454 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:26.721506 (+ 2052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:26.723791 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:26.723802 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:26.723823 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:26.724131 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:26.724491 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:26.724495 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:26.724497 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:26.724734 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:26.725279 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:26.725288 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:26.725786 (+ 498us) client_negotiation.cc:769] Sending connection context
0807 15:23:26.726062 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 15:23:26.726542 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":135,"threads_started":1}
I20260807 15:23:26.727972 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.717764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50464 (local address 127.15.242.254:39455)
0807 15:23:26.718121 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.718125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.718290 (+ 165us) server_negotiation.cc:407] Connection header received
0807 15:23:26.718457 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.718460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.718509 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.718585 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:26.719616 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.720397 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.721724 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.722124 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.722207 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.723887 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:26.723890 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:26.723892 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:26.723915 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:26.725982 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.726558 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.726562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.726564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.726687 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.727023 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.727026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.727028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.727263 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:26.727569 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.727657 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.727791 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":150,"threads_started":1}
I20260807 15:23:26.729269 9008 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39455
I20260807 15:23:26.729550 9008 heartbeater.cc:464] Registering TS with master...
I20260807 15:23:26.730182 9008 heartbeater.cc:511] Master 127.15.242.254:39455 requested a full tablet report, sending...
I20260807 15:23:26.731336 8278 ts_manager.cc:194] Registered new tserver with Master: b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929)
I20260807 15:23:26.731973 8278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:57769
I20260807 15:23:26.742662 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:23:26.747581 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.743451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50468 (local address 127.15.242.254:39455)
0807 15:23:26.743633 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.743638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.743867 (+ 229us) server_negotiation.cc:407] Connection header received
0807 15:23:26.744072 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.744074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.744190 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.744332 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:23:26.744646 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.745371 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.746341 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.746576 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.746670 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.747067 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:23:26.747233 (+ 166us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 15:23:26.747469 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50468: token expired
Metrics: {"server-negotiator.queue_time_us":80}
W20260807 15:23:26.747714 9014 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50468: token expired
W20260807 15:23:26.748100 8171 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.242.254:39455)
I20260807 15:23:26.755929 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.748534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50480 (local address 127.15.242.254:39455)
0807 15:23:26.748662 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.748667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.748682 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:23:26.748877 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.748880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.748922 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.748987 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:26.749597 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.750079 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.750936 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.751145 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.751241 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.752662 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:26.752665 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:26.752667 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:26.752691 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:26.754353 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.754791 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.754794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.754796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.754880 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:26.755153 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:26.755156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:26.755157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:26.755328 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:26.755435 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.755707 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.755812 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 15:23:26.758700 8278 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50480:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:23:26.762290 8278 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:23:26.771143 8486 tablet_service.cc:1467] Processing CreateTablet for tablet bba59fc2f0364f9e88b6c7838b8706c9 (DEFAULT_TABLE table=test-table [id=cb3784f00324476f8feee8736211a81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:23:26.771929 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bba59fc2f0364f9e88b6c7838b8706c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:23:26.775079 8410 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Bootstrap starting.
I20260807 15:23:26.775735 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.769978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:40679 (local address 127.0.0.1:41626)
0807 15:23:26.770147 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.770165 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:26.770272 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:26.771515 (+ 1243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:26.771518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:26.771537 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:26.771664 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.771670 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.773240 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.773243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.774124 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.774135 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.775236 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.775240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.775349 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.775410 (+ 61us) client_negotiation.cc:769] Sending connection context
0807 15:23:26.775468 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 15:23:26.775564 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":1}
I20260807 15:23:26.776122 8410 tablet_bootstrap.cc:654] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Neither blocks nor log segments found. Creating new log.
I20260807 15:23:26.776371 9023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.770499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42929 (local address 127.0.0.1:35516)
0807 15:23:26.770845 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.770861 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:26.770963 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:26.771799 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:26.771802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:26.771822 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:26.771933 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.771940 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.773249 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.773252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.774465 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.774477 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.775948 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.775951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.776074 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.776098 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 15:23:26.776152 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 15:23:26.776241 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":29,"thread_start_us":112,"threads_started":1}
I20260807 15:23:26.776485 9021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.770212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41626 (local address 127.15.242.194:40679)
0807 15:23:26.770932 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.770947 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.770975 (+ 28us) server_negotiation.cc:407] Connection header received
0807 15:23:26.771072 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.771078 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.771325 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.771841 (+ 516us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:26.772034 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.773132 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.774264 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.775075 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.775960 (+ 885us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.776166 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.776220 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.776321 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":207,"threads_started":1}
I20260807 15:23:26.777163 9024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.770943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35516 (local address 127.15.242.195:42929)
0807 15:23:26.771277 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.771289 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.771320 (+ 31us) server_negotiation.cc:407] Connection header received
0807 15:23:26.771425 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.771432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.771643 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.771833 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:26.772038 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.773122 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.774605 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.775572 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.776690 (+ 1118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.776854 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.776906 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.777025 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":144,"threads_started":1}
I20260807 15:23:26.778057 8410 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: No bootstrap required, opened a new log
I20260807 15:23:26.778179 8410 ts_tablet_manager.cc:1397] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260807 15:23:26.778877 8410 raft_consensus.cc:348] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.779145 8410 raft_consensus.cc:374] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:23:26.779206 8410 raft_consensus.cc:729] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e327b51620884c2aa9b2d6bb8b3d2668, State: Initialized, Role: FOLLOWER
I20260807 15:23:26.779345 8410 consensus_queue.cc:260] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.779639 8410 ts_tablet_manager.cc:1428] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 15:23:26.780095 8711 tablet_service.cc:1467] Processing CreateTablet for tablet bba59fc2f0364f9e88b6c7838b8706c9 (DEFAULT_TABLE table=test-table [id=cb3784f00324476f8feee8736211a81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:23:26.781275 8711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bba59fc2f0364f9e88b6c7838b8706c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:23:26.783074 8912 tablet_service.cc:1467] Processing CreateTablet for tablet bba59fc2f0364f9e88b6c7838b8706c9 (DEFAULT_TABLE table=test-table [id=cb3784f00324476f8feee8736211a81c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:23:26.784229 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bba59fc2f0364f9e88b6c7838b8706c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:23:26.790270 9027 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: Bootstrap starting.
I20260807 15:23:26.791780 9029 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: Bootstrap starting.
I20260807 15:23:26.793361 9027 tablet_bootstrap.cc:654] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: Neither blocks nor log segments found. Creating new log.
I20260807 15:23:26.794148 9029 tablet_bootstrap.cc:654] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: Neither blocks nor log segments found. Creating new log.
I20260807 15:23:26.794359 9027 log.cc:824] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:26.795506 9029 log.cc:824] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:26.796903 9027 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: No bootstrap required, opened a new log
I20260807 15:23:26.797147 9027 ts_tablet_manager.cc:1397] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:23:26.798098 9029 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: No bootstrap required, opened a new log
I20260807 15:23:26.798388 9029 ts_tablet_manager.cc:1397] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 15:23:26.800716 9027 raft_consensus.cc:348] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.801069 9027 raft_consensus.cc:374] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:23:26.801153 9027 raft_consensus.cc:729] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3572868ad79e47889c60347ea7ec9af3, State: Initialized, Role: FOLLOWER
I20260807 15:23:26.801659 9027 consensus_queue.cc:260] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.801924 9029 raft_consensus.cc:348] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.802166 9029 raft_consensus.cc:374] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:23:26.802227 9029 raft_consensus.cc:729] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b70d709bee174d85a5acb23bee8d99e9, State: Initialized, Role: FOLLOWER
I20260807 15:23:26.802390 8807 heartbeater.cc:503] Master 127.15.242.254:39455 was elected leader, sending a full tablet report...
I20260807 15:23:26.802757 9027 ts_tablet_manager.cc:1428] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:23:26.802711 9029 consensus_queue.cc:260] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.803462 9008 heartbeater.cc:503] Master 127.15.242.254:39455 was elected leader, sending a full tablet report...
I20260807 15:23:26.803668 9029 ts_tablet_manager.cc:1428] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: Time spent starting tablet: real 0.005s user 0.002s sys 0.004s
I20260807 15:23:26.879082 8602 raft_consensus.cc:482] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:23:26.879405 8602 raft_consensus.cc:504] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.881049 8602 leader_election.cc:288] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679), b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929)
I20260807 15:23:26.885821 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.881262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:40679 (local address 127.15.242.193:57285)
0807 15:23:26.881635 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.881652 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:26.881838 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:26.882291 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:26.882294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:26.882306 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:26.882456 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.882464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.883406 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.883410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.884448 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.884460 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.885298 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.885302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.885402 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.885474 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 15:23:26.885557 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 15:23:26.885653 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":48,"thread_start_us":112,"threads_started":1}
I20260807 15:23:26.886013 9021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.881473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:57285 (local address 127.15.242.194:40679)
0807 15:23:26.881637 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.881645 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.881740 (+ 95us) server_negotiation.cc:407] Connection header received
0807 15:23:26.882015 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.882021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.882075 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.882115 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:26.882657 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.883277 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.884585 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.885148 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.885251 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.885299 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.885700 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.885804 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 15:23:26.886286 9035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.881358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42929 (local address 127.15.242.193:43221)
0807 15:23:26.881829 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.881842 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:26.881920 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:26.882234 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:26.882239 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:26.882262 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:23:26.882459 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.882464 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.883643 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.883646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.884732 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:26.884744 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.885646 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.885653 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:26.885783 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.885816 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 15:23:26.885951 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 15:23:26.886038 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":62,"thread_start_us":85,"threads_started":1}
I20260807 15:23:26.886562 9024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.881827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:43221 (local address 127.15.242.195:42929)
0807 15:23:26.881969 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.881976 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.881995 (+ 19us) server_negotiation.cc:407] Connection header received
0807 15:23:26.882072 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.882074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.882115 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.882182 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:23:26.882860 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.883506 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.884888 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.885425 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.885572 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.885621 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.886308 (+ 687us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.886430 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 15:23:26.886933 8741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba59fc2f0364f9e88b6c7838b8706c9" candidate_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3572868ad79e47889c60347ea7ec9af3" is_pre_election: true
I20260807 15:23:26.887346 8941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba59fc2f0364f9e88b6c7838b8706c9" candidate_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b70d709bee174d85a5acb23bee8d99e9" is_pre_election: true
I20260807 15:23:26.887393 8741 raft_consensus.cc:2454] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e327b51620884c2aa9b2d6bb8b3d2668 in term 0.
I20260807 15:23:26.887691 8941 raft_consensus.cc:2454] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e327b51620884c2aa9b2d6bb8b3d2668 in term 0.
I20260807 15:23:26.888129 8403 leader_election.cc:302] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3572868ad79e47889c60347ea7ec9af3, e327b51620884c2aa9b2d6bb8b3d2668; no voters:
I20260807 15:23:26.888489 8602 raft_consensus.cc:2781] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:23:26.888587 8602 raft_consensus.cc:482] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:23:26.888630 8602 raft_consensus.cc:3037] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:23:26.889818 8602 raft_consensus.cc:504] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.890239 8602 leader_election.cc:288] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 1 election: Requested vote from peers 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679), b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929)
I20260807 15:23:26.890678 8941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba59fc2f0364f9e88b6c7838b8706c9" candidate_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b70d709bee174d85a5acb23bee8d99e9"
I20260807 15:23:26.890671 8741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba59fc2f0364f9e88b6c7838b8706c9" candidate_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3572868ad79e47889c60347ea7ec9af3"
I20260807 15:23:26.890818 8941 raft_consensus.cc:3037] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:23:26.890818 8741 raft_consensus.cc:3037] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:23:26.892221 8941 raft_consensus.cc:2454] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e327b51620884c2aa9b2d6bb8b3d2668 in term 1.
I20260807 15:23:26.892222 8741 raft_consensus.cc:2454] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e327b51620884c2aa9b2d6bb8b3d2668 in term 1.
I20260807 15:23:26.892596 8403 leader_election.cc:302] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3572868ad79e47889c60347ea7ec9af3, e327b51620884c2aa9b2d6bb8b3d2668; no voters:
I20260807 15:23:26.892881 8602 raft_consensus.cc:2781] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:23:26.893121 8602 raft_consensus.cc:686] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 LEADER]: Becoming Leader. State: Replica: e327b51620884c2aa9b2d6bb8b3d2668, State: Running, Role: LEADER
I20260807 15:23:26.893424 8602 consensus_queue.cc:237] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:26.896613 8278 catalog_manager.cc:5495] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 reported cstate change: term changed from 0 to 1, leader changed from <none> to e327b51620884c2aa9b2d6bb8b3d2668 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } health_report { overall_health: HEALTHY } } }
I20260807 15:23:26.915825 9042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.911793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60448 (local address 127.15.242.193:42971)
0807 15:23:26.912108 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:26.912117 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:26.912131 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:23:26.912214 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:26.912216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:26.912275 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:26.912416 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:23:26.912741 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.913339 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.914213 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:26.914465 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:26.914574 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:26.914884 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:23:26.915369 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:23:26.915509 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:26.915573 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 15:23:26.915644 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":99,"threads_started":1}
I20260807 15:23:26.921044 8941 raft_consensus.cc:1261] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 1 FOLLOWER]: Refusing update from remote peer e327b51620884c2aa9b2d6bb8b3d2668: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:23:26.921044 8741 raft_consensus.cc:1261] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 1 FOLLOWER]: Refusing update from remote peer e327b51620884c2aa9b2d6bb8b3d2668: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:23:26.921936 9036 consensus_queue.cc:1035] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:23:26.922161 8602 consensus_queue.cc:1035] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:23:26.930487 9043 mvcc.cc:205] Tried to move back new op lower bound from 7315931983540207616 to 7315931983438270464. Current Snapshot: MvccSnapshot[applied={T|T < 7315931983540207616}]
I20260807 15:23:26.931648 9044 mvcc.cc:205] Tried to move back new op lower bound from 7315931983540207616 to 7315931983438270464. Current Snapshot: MvccSnapshot[applied={T|T < 7315931983540207616}]
I20260807 15:23:26.939342 8278 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:23:26.939535 8278 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:23:26.942124 8278 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Sending DeleteTablet for 3 replicas of tablet bba59fc2f0364f9e88b6c7838b8706c9
I20260807 15:23:26.942991 8711 tablet_service.cc:1514] Processing DeleteTablet for tablet bba59fc2f0364f9e88b6c7838b8706c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:23:26 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:41626
I20260807 15:23:26.943060 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet bba59fc2f0364f9e88b6c7838b8706c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:23:26 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:59618
I20260807 15:23:26.942996 8912 tablet_service.cc:1514] Processing DeleteTablet for tablet bba59fc2f0364f9e88b6c7838b8706c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:23:26 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:35516
I20260807 15:23:26.943490 9056 tablet_replica.cc:330] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: stopping tablet replica
I20260807 15:23:26.943526 9062 tablet_replica.cc:330] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: stopping tablet replica
I20260807 15:23:26.943688 9056 raft_consensus.cc:2229] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:23:26.943711 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 8346
I20260807 15:23:26.947973 9062 raft_consensus.cc:2229] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:23:26.948340 9062 raft_consensus.cc:2258] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:23:26.952154 9062 ts_tablet_manager.cc:1905] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:23:26.956033 9062 ts_tablet_manager.cc:1918] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:23:26.956166 9062 log.cc:1196] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/bba59fc2f0364f9e88b6c7838b8706c9
I20260807 15:23:26.956507 9062 ts_tablet_manager.cc:1939] T bba59fc2f0364f9e88b6c7838b8706c9 P 3572868ad79e47889c60347ea7ec9af3: Deleting consensus metadata
I20260807 15:23:26.957712 9060 tablet_replica.cc:330] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: stopping tablet replica
I20260807 15:23:26.958039 9060 raft_consensus.cc:2229] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:23:26.958351 9060 raft_consensus.cc:2258] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:23:26.958534 8254 catalog_manager.cc:4841] TS 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679): tablet bba59fc2f0364f9e88b6c7838b8706c9 (table test-table [id=cb3784f00324476f8feee8736211a81c]) successfully deleted
I20260807 15:23:26.962026 9060 ts_tablet_manager.cc:1905] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:23:26.965052 9060 ts_tablet_manager.cc:1918] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:23:26.965160 9060 log.cc:1196] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/bba59fc2f0364f9e88b6c7838b8706c9
I20260807 15:23:26.965530 9060 ts_tablet_manager.cc:1939] T bba59fc2f0364f9e88b6c7838b8706c9 P b70d709bee174d85a5acb23bee8d99e9: Deleting consensus metadata
I20260807 15:23:26.966833 8256 catalog_manager.cc:4841] TS b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929): tablet bba59fc2f0364f9e88b6c7838b8706c9 (table test-table [id=cb3784f00324476f8feee8736211a81c]) successfully deleted
W20260807 15:23:26.970677 8255 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:42971 (error 108)
I20260807 15:23:26.971611 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 8596
I20260807 15:23:26.971947 9023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:26.971618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:42971 (local address 127.0.0.1:60462)
0807 15:23:26.971771 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:26.971846 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:42971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 15:23:26.976728 8255 catalog_manager.cc:4584] TS e327b51620884c2aa9b2d6bb8b3d2668 (127.15.242.193:42971): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bba59fc2f0364f9e88b6c7838b8706c9: Network error: Client connection negotiation failed: client connection to 127.15.242.193:42971: connect: Connection refused (error 111)
I20260807 15:23:26.983752 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 8810
I20260807 15:23:26.997160 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 8231
I20260807 15:23:47.010804 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39455
--webserver_interface=127.15.242.254
--webserver_port=44075
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:39455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:23:47.129346 9065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:47.129631 9065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:47.129673 9065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:47.134373 9065 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 15:23:47.134429 9065 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 15:23:47.134445 9065 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 15:23:47.134461 9065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:23:47.134480 9065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:47.134542 9065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:47.134572 9065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:23:47.134606 9065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:23:47.139995 9065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:39455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=44075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:47.141189 9065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:47.142302 9065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:47.152383 9079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:47.152374 9074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:47.152443 9065 server_base.cc:1034] running on GCE node
W20260807 15:23:47.152369 9076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:47.153378 9065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:47.154541 9065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:47.155732 9065 hybrid_clock.cc:648] HybridClock initialized: now 1786116227155710 us; error 35 us; skew 500 ppm
Aug 07 15:23:47 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116227, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:47.162600 9065 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:23:47.163713 9065 webserver.cc:460] Webserver started at http://127.15.242.254:44075/ using document root <none> and password file <none>
I20260807 15:23:47.164333 9065 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:47.164408 9065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:47.168892 9065 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:23:47.171211 9091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:47.172560 9065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:23:47.172675 9065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "62e463af9275423e87e9ed4210d8e054"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "e7280f726e32b05b464cf498c2b7a4bd"
server_key_iv: "4f66c23d48b9c70504528d024cbda0ce"
server_key_version: "encryptionkey@0"
I20260807 15:23:47.173285 9065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:47.189553 9065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:47.192647 9065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:47.192934 9065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:47.200464 9065 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:39455
I20260807 15:23:47.200856 9177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:39455 every 8 connection(s)
I20260807 15:23:47.201664 9065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:23:47.206413 9178 sys_catalog.cc:263] Verifying existing consensus state
I20260807 15:23:47.208263 9178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Bootstrap starting.
I20260807 15:23:47.209709 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 9065
I20260807 15:23:47.210250 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:42971
--local_ip_for_outbound_sockets=127.15.242.193
--tserver_master_addrs=127.15.242.254:39455
--webserver_port=44869
--webserver_interface=127.15.242.193
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:23:47.227960 9178 log.cc:824] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:47.240851 9178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:23:47.241300 9178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Bootstrap complete.
I20260807 15:23:47.245756 9178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:47.246227 9178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62e463af9275423e87e9ed4210d8e054, State: Initialized, Role: FOLLOWER
I20260807 15:23:47.246768 9178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:47.246937 9178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:23:47.247035 9178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:23:47.247174 9178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 2 FOLLOWER]: Advancing to term 3
I20260807 15:23:47.249315 9178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:47.249683 9178 leader_election.cc:302] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62e463af9275423e87e9ed4210d8e054; no voters:
I20260807 15:23:47.250053 9178 leader_election.cc:288] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 15:23:47.250157 9183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 15:23:47.250407 9183 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [term 3 LEADER]: Becoming Leader. State: Replica: 62e463af9275423e87e9ed4210d8e054, State: Running, Role: LEADER
I20260807 15:23:47.250743 9183 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } }
I20260807 15:23:47.251474 9178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:23:47.251802 9185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "62e463af9275423e87e9ed4210d8e054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } } }
I20260807 15:23:47.251940 9185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: This master's current role is: LEADER
I20260807 15:23:47.252285 9184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62e463af9275423e87e9ed4210d8e054. Latest consensus state: current_term: 3 leader_uuid: "62e463af9275423e87e9ed4210d8e054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62e463af9275423e87e9ed4210d8e054" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39455 } } }
I20260807 15:23:47.252413 9184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054 [sys.catalog]: This master's current role is: LEADER
I20260807 15:23:47.252808 9188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:23:47.258430 9188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:23:47.259274 9188 catalog_manager.cc:1259] Loaded cluster ID: 9c0a137dc995434eb151f7770b23046c
I20260807 15:23:47.259363 9188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:23:47.261336 9188 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:23:47.262002 9188 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Loaded TSK: 0
I20260807 15:23:47.262104 9188 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 62e463af9275423e87e9ed4210d8e054: Loaded TSK: 1
F20260807 15:23:47.262745 9188 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f00fe2979ad google::LogMessage::Fail() at ??:0
@ 0x7f00fe29a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f00fe2974de google::LogMessage::Flush() at ??:0
@ 0x7f00fe298a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0100f5b18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f0100f53f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f0108bfc7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f0108bd699c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f0108bd7178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f0108c18df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f0108c3782b std::function<>::operator()() at ??:0
@ 0x7f0108bd6b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f0108bd7f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0108bd4579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f0108c18640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f01004e93d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f01004e9c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f01004eb3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f01004da512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0101b1e6db start_thread at ??:0
@ 0x7f00fcd9561f clone at ??:0
W20260807 15:23:47.366489 9180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:47.366763 9180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:47.366813 9180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:47.371806 9180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:47.371856 9180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:47.371922 9180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:23:47.378304 9180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:42971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=44869
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:47.379679 9180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:47.380877 9180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:47.391981 9247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:47.391985 9251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:47.391976 9246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:47.392594 9180 server_base.cc:1034] running on GCE node
I20260807 15:23:47.393122 9180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:47.393927 9180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:47.395138 9180 hybrid_clock.cc:648] HybridClock initialized: now 1786116227395113 us; error 39 us; skew 500 ppm
Aug 07 15:23:47 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116227, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:47.398630 9180 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:23:47.399778 9180 webserver.cc:460] Webserver started at http://127.15.242.193:44869/ using document root <none> and password file <none>
I20260807 15:23:47.400516 9180 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:47.400614 9180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:47.406407 9180 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:23:47.409495 9259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:47.411315 9180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 15:23:47.411476 9180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "e327b51620884c2aa9b2d6bb8b3d2668"
format_stamp: "Formatted at 2026-08-07 15:23:04 on dist-test-slave-g170"
server_key: "0cea3a3e5310a9308a0d9cdc12026284"
server_key_iv: "47ad113e1bfc28bc705032f3a1b901ba"
server_key_version: "encryptionkey@0"
I20260807 15:23:47.412285 9180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:47.436471 9180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:47.441378 9180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:47.441615 9180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:47.442440 9180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:47.444129 9269 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 15:23:47.448815 9180 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 15:23:47.448920 9180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260807 15:23:47.449003 9180 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 15:23:47.451758 9180 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 15:23:47.451841 9180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260807 15:23:47.452257 9269 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Bootstrap starting.
I20260807 15:23:47.464412 9180 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:42971
I20260807 15:23:47.465961 9180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:23:47.466229 9443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:42971 every 8 connection(s)
I20260807 15:23:47.469538 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 9180
I20260807 15:23:47.470183 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:40679
--local_ip_for_outbound_sockets=127.15.242.194
--tserver_master_addrs=127.15.242.254:39455
--webserver_port=39287
--webserver_interface=127.15.242.194
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:23:47.479195 9269 log.cc:824] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Log is configured to *not* fsync() on all Append() calls
I20260807 15:23:47.487437 9269 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 15:23:47.487884 9269 tablet_bootstrap.cc:492] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Bootstrap complete.
I20260807 15:23:47.489429 9269 ts_tablet_manager.cc:1397] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Time spent bootstrapping tablet: real 0.037s user 0.023s sys 0.011s
I20260807 15:23:47.492098 9269 raft_consensus.cc:348] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:47.492566 9269 raft_consensus.cc:729] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e327b51620884c2aa9b2d6bb8b3d2668, State: Initialized, Role: FOLLOWER
I20260807 15:23:47.493176 9269 consensus_queue.cc:260] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:47.494155 9269 ts_tablet_manager.cc:1428] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
W20260807 15:23:47.558375 9447 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:23:47.468280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:36875)
0807 15:23:47.469105 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.469169 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:47.470723 (+ 1554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:47.557507 (+ 86784us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":120,"threads_started":1}
W20260807 15:23:47.558934 9444 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:39455 (0 consecutive failures): Network error: Failed to ping master at 127.15.242.254:39455: Client connection negotiation failed: client connection to 127.15.242.254:39455: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 15:23:47.559779 9447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:47.559510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:58035)
0807 15:23:47.559647 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.559720 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 15:23:47.560648 9447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:47.560453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:54843)
0807 15:23:47.560556 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.560598 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 15:23:47.560878 9444 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 15:23:47.609506 9449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:47.609769 9449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:47.609810 9449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:47.613863 9449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:47.613916 9449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:47.614006 9449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:23:47.623311 9449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:40679
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=39287
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:47.624526 9449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:47.625975 9449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:47.636456 9465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:47.636471 9464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:47.636471 9467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:47.636706 9449 server_base.cc:1034] running on GCE node
I20260807 15:23:47.637138 9449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:47.637777 9449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:47.638957 9449 hybrid_clock.cc:648] HybridClock initialized: now 1786116227638920 us; error 46 us; skew 500 ppm
Aug 07 15:23:47 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116227, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:47.641781 9449 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:23:47.642722 9449 webserver.cc:460] Webserver started at http://127.15.242.194:39287/ using document root <none> and password file <none>
I20260807 15:23:47.643322 9449 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:47.643417 9449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:47.647518 9449 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:23:47.649775 9479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:47.651031 9449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:23:47.651201 9449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "3572868ad79e47889c60347ea7ec9af3"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "c1029632acf56ef99c4d7013d3274607"
server_key_iv: "b89a4d3773f092fa80cf57e280455acd"
server_key_version: "encryptionkey@0"
I20260807 15:23:47.651790 9449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:47.676934 9449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:47.680279 9449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:47.680500 9449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:47.681190 9449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:47.682087 9449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:23:47.682163 9449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:47.682233 9449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:23:47.682278 9449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:47.692242 9449 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:40679
I20260807 15:23:47.692337 9645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:40679 every 8 connection(s)
I20260807 15:23:47.693362 9449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:23:47.695791 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 9449
I20260807 15:23:47.696328 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:42929
--local_ip_for_outbound_sockets=127.15.242.195
--tserver_master_addrs=127.15.242.254:39455
--webserver_port=33743
--webserver_interface=127.15.242.195
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:23:47.698004 9650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:47.695577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:41837)
0807 15:23:47.696160 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.696309 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":135,"threads_started":1}
W20260807 15:23:47.698537 9647 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:39455 (0 consecutive failures): Network error: Failed to ping master at 127.15.242.254:39455: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
I20260807 15:23:47.699252 9650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:47.699023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:60047)
0807 15:23:47.699137 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.699196 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 15:23:47.699980 9650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:47.699718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:48649)
0807 15:23:47.699841 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.699900 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 15:23:47.700171 9647 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 15:23:47.813766 9651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:23:47.814034 9651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:23:47.814077 9651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:23:47.818123 9651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:23:47.818185 9651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:23:47.818246 9651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:23:47.823663 9651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:42929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=33743
--tserver_master_addrs=127.15.242.254:39455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:23:47.824847 9651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:23:47.825922 9651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:23:47.836105 9662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:47.836170 9660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:23:47.836143 9664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:23:47.836432 9651 server_base.cc:1034] running on GCE node
I20260807 15:23:47.836978 9651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:23:47.837764 9651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:23:47.838963 9651 hybrid_clock.cc:648] HybridClock initialized: now 1786116227838894 us; error 83 us; skew 500 ppm
Aug 07 15:23:47 dist-test-slave-g170 krb5kdc[7402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116227, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:23:47.842149 9651 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:23:47.843132 9651 webserver.cc:460] Webserver started at http://127.15.242.195:33743/ using document root <none> and password file <none>
I20260807 15:23:47.843741 9651 fs_manager.cc:359] Metadata directory not provided
I20260807 15:23:47.843816 9651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:23:47.848342 9651 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:23:47.850885 9672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:47.852358 9651 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:23:47.852531 9651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "b70d709bee174d85a5acb23bee8d99e9"
format_stamp: "Formatted at 2026-08-07 15:23:05 on dist-test-slave-g170"
server_key: "5f9e72a105a5461b14422e48560b0d8b"
server_key_iv: "02a8b486b30a719ed263f02ade37fbb3"
server_key_version: "encryptionkey@0"
I20260807 15:23:47.853227 9651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:23:47.865958 9651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:23:47.870220 9651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:23:47.870471 9651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:23:47.871176 9651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:23:47.872227 9651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:23:47.872278 9651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:47.872357 9651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:23:47.872390 9651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:23:47.881964 9651 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:42929
I20260807 15:23:47.881989 9845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:42929 every 8 connection(s)
I20260807 15:23:47.883025 9651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:23:47.885080 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 9651
I20260807 15:23:47.887504 9849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:47.885499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:37493)
0807 15:23:47.886155 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.886295 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":162,"threads_started":1}
W20260807 15:23:47.888006 9846 heartbeater.cc:644] Failed to heartbeat to 127.15.242.254:39455 (0 consecutive failures): Network error: Failed to ping master at 127.15.242.254:39455: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
I20260807 15:23:47.888638 9849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:47.888404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:55373)
0807 15:23:47.888530 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.888581 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 15:23:47.889460 9849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:47.889257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:57863)
0807 15:23:47.889369 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:47.889413 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 15:23:47.889787 9846 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 15:23:48.561925 9854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:48.561457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:57227)
0807 15:23:48.561757 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:48.561817 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":75,"threads_started":1}
I20260807 15:23:48.701453 9855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:48.700898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:55679)
0807 15:23:48.701247 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:48.701320 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":91,"threads_started":1}
I20260807 15:23:48.890866 9856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:48.890427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:43967)
0807 15:23:48.890688 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:48.890758 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":74,"threads_started":1}
I20260807 15:23:49.367030 9857 raft_consensus.cc:482] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:23:49.367394 9857 raft_consensus.cc:504] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:49.368759 9857 leader_election.cc:288] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679), b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929)
Aug 07 15:23:49 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116227, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.195@KRBTEST.COM
Aug 07 15:23:49 dist-test-slave-g170 krb5kdc[7402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116227, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.194@KRBTEST.COM
I20260807 15:23:49.383509 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:49.369077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:40679 (local address 127.15.242.193:41039)
0807 15:23:49.369449 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:49.369465 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:49.369583 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:49.371475 (+ 1892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:49.371481 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:49.372092 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:49.372589 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:49.372605 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:49.374055 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:49.374058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:49.375056 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:49.375067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:49.375824 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:49.375827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:49.376009 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:49.376854 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:49.376869 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:49.379095 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:49.381500 (+ 2405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:49.381505 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:49.381507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:49.381716 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:49.382072 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:49.382076 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:49.382078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:49.382174 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:49.382780 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:49.382783 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:49.382881 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 15:23:49.383004 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 15:23:49.383289 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":84,"thread_start_us":122,"threads_started":1}
I20260807 15:23:49.383584 9864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:49.369271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:52183 (local address 127.15.242.195:42929)
0807 15:23:49.369880 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:49.369906 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:49.370233 (+ 327us) server_negotiation.cc:407] Connection header received
0807 15:23:49.370958 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:49.370964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:49.371302 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:49.371704 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:49.372839 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:49.373902 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:49.375217 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:49.375745 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:49.375940 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:49.379050 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:49.379055 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:49.379068 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:49.379104 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:49.380872 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:49.381407 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:49.381415 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:49.381425 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:49.381542 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:49.381912 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:49.381916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:49.381918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:49.382343 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:49.382497 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:49.383025 (+ 528us) server_negotiation.cc:299] Negotiation successful
0807 15:23:49.383421 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":100,"threads_started":1}
I20260807 15:23:49.383723 9860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:49.369269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:41039 (local address 127.15.242.194:40679)
0807 15:23:49.369713 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0807 15:23:49.369732 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 15:23:49.369780 (+ 48us) server_negotiation.cc:407] Connection header received
0807 15:23:49.370672 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:23:49.370682 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:23:49.371069 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:23:49.371405 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:23:49.372859 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:49.373868 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:49.375195 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:23:49.375676 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:23:49.375856 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:49.379308 (+ 3452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:23:49.379312 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:23:49.379323 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:23:49.379352 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:23:49.381375 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:49.381836 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:49.381842 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:49.381854 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:49.381966 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:23:49.382275 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:23:49.382278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:23:49.382280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:23:49.382663 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:23:49.382812 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 15:23:49.383147 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 15:23:49.383491 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":77,"threads_started":1}
I20260807 15:23:49.383563 9859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:49.369121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42929 (local address 127.15.242.193:52183)
0807 15:23:49.370091 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:49.370106 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:23:49.370216 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:23:49.371555 (+ 1339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:23:49.371559 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:23:49.372117 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:23:49.372602 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:49.372612 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:49.374054 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:49.374059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:49.375051 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:23:49.375062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:23:49.375888 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:23:49.375892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:23:49.376009 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:23:49.376850 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:23:49.376893 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:23:49.378805 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:23:49.381003 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:49.381009 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:49.381022 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:49.381284 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:49.381655 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:23:49.381658 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:23:49.381660 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:23:49.381812 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:23:49.382471 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:23:49.382478 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:23:49.382716 (+ 238us) client_negotiation.cc:769] Sending connection context
0807 15:23:49.382907 (+ 191us) client_negotiation.cc:240] Negotiation successful
0807 15:23:49.383369 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"mutex_wait_us":265,"spinlock_wait_cycles":30592,"thread_start_us":83,"threads_started":1}
W20260807 15:23:49.387529 9265 leader_election.cc:341] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929): Not found: Tablet not found: bba59fc2f0364f9e88b6c7838b8706c9
W20260807 15:23:49.387705 9263 leader_election.cc:341] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679): Not found: Tablet not found: bba59fc2f0364f9e88b6c7838b8706c9
I20260807 15:23:49.387786 9263 leader_election.cc:302] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e327b51620884c2aa9b2d6bb8b3d2668; no voters: 3572868ad79e47889c60347ea7ec9af3, b70d709bee174d85a5acb23bee8d99e9
I20260807 15:23:49.388067 9857 raft_consensus.cc:2726] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:23:49.563033 9859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:49.562739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:48411)
0807 15:23:49.562883 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:49.562943 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 15:23:49.702724 9865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:49.702252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:42389)
0807 15:23:49.702547 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:49.702608 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":99,"threads_started":1}
I20260807 15:23:49.892207 9866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:49.891749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:57497)
0807 15:23:49.892046 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:49.892109 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":109,"threads_started":1}
I20260807 15:23:50.564249 9867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:50.563835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:41647)
0807 15:23:50.564089 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:50.564146 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":82,"threads_started":1}
I20260807 15:23:50.703926 9871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:50.703499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:35429)
0807 15:23:50.703773 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:50.703830 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":84,"threads_started":1}
I20260807 15:23:50.893589 9872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:50.893160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:46985)
0807 15:23:50.893428 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:50.893489 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":76,"threads_started":1}
I20260807 15:23:51.565742 9873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:51.565153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:38693)
0807 15:23:51.565503 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:51.565588 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":93,"threads_started":1}
I20260807 15:23:51.619894 9874 raft_consensus.cc:482] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:23:51.620048 9874 raft_consensus.cc:504] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:51.620621 9874 leader_election.cc:288] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679), b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929)
W20260807 15:23:51.621670 9265 leader_election.cc:341] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929): Not found: Tablet not found: bba59fc2f0364f9e88b6c7838b8706c9
W20260807 15:23:51.621851 9263 leader_election.cc:341] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679): Not found: Tablet not found: bba59fc2f0364f9e88b6c7838b8706c9
I20260807 15:23:51.621968 9263 leader_election.cc:302] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e327b51620884c2aa9b2d6bb8b3d2668; no voters: 3572868ad79e47889c60347ea7ec9af3, b70d709bee174d85a5acb23bee8d99e9
I20260807 15:23:51.622166 9874 raft_consensus.cc:2726] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:23:51.705533 9877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:51.705011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:46259)
0807 15:23:51.705332 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:51.705399 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":105,"threads_started":1}
I20260807 15:23:51.895043 9879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:51.894511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:39257)
0807 15:23:51.894877 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:51.894946 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":84,"threads_started":1}
I20260807 15:23:52.567339 9880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:52.566813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:56149)
0807 15:23:52.567163 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:52.567237 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":80,"threads_started":1}
I20260807 15:23:52.706933 9881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:52.706480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:57077)
0807 15:23:52.706771 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:52.706833 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":88,"threads_started":1}
I20260807 15:23:52.896639 9883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:52.896122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:41073)
0807 15:23:52.896416 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:52.896484 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":109,"threads_started":1}
I20260807 15:23:53.568740 9884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:53.568266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:36683)
0807 15:23:53.568567 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:53.568628 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":84,"threads_started":1}
I20260807 15:23:53.708149 9885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:53.707734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:49965)
0807 15:23:53.707992 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:53.708053 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":78,"threads_started":1}
I20260807 15:23:53.897962 9892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:53.897456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:53179)
0807 15:23:53.897807 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:53.897867 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":94,"threads_started":1}
I20260807 15:23:54.570107 9893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:54.569594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:54591)
0807 15:23:54.569946 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:54.570005 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":151,"threads_started":1}
I20260807 15:23:54.709749 9897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:54.709188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:45671)
0807 15:23:54.709577 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:54.709650 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":146,"threads_started":1}
I20260807 15:23:54.716295 9901 raft_consensus.cc:482] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:23:54.716528 9901 raft_consensus.cc:504] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:54.717080 9901 leader_election.cc:288] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679), b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929)
W20260807 15:23:54.718151 9263 leader_election.cc:341] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679): Not found: Tablet not found: bba59fc2f0364f9e88b6c7838b8706c9
W20260807 15:23:54.718362 9265 leader_election.cc:341] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929): Not found: Tablet not found: bba59fc2f0364f9e88b6c7838b8706c9
I20260807 15:23:54.718480 9265 leader_election.cc:302] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e327b51620884c2aa9b2d6bb8b3d2668; no voters: 3572868ad79e47889c60347ea7ec9af3, b70d709bee174d85a5acb23bee8d99e9
I20260807 15:23:54.718700 9901 raft_consensus.cc:2726] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:23:54.899523 9902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:54.898925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:40683)
0807 15:23:54.899344 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:54.899420 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":119,"threads_started":1}
I20260807 15:23:55.571470 9903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:55.571003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:37621)
0807 15:23:55.571299 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:55.571362 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":78,"threads_started":1}
I20260807 15:23:55.711118 9906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:55.710608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:51025)
0807 15:23:55.710927 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:55.711011 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":79,"threads_started":1}
I20260807 15:23:55.901032 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:55.900459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:47605)
0807 15:23:55.900806 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:55.900896 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":125,"threads_started":1}
I20260807 15:23:56.572950 9910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:56.572384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:46201)
0807 15:23:56.572710 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:56.572850 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":115,"threads_started":1}
I20260807 15:23:56.712433 9912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:56.711984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:45213)
0807 15:23:56.712269 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:56.712331 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":105,"threads_started":1}
I20260807 15:23:56.902359 9913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:56.901908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:39055)
0807 15:23:56.902203 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:56.902263 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":102,"threads_started":1}
I20260807 15:23:57.574354 9914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:57.573927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:41067)
0807 15:23:57.574187 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:57.574255 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":78,"threads_started":1}
I20260807 15:23:57.713757 9915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:57.713314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:59753)
0807 15:23:57.713594 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:57.713651 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":105,"threads_started":1}
I20260807 15:23:57.903889 9916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:57.903382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:59595)
0807 15:23:57.903722 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:57.903789 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":116,"threads_started":1}
I20260807 15:23:58.575902 9917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:58.575381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:38861)
0807 15:23:58.575732 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:58.575799 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":87,"threads_started":1}
I20260807 15:23:58.715124 9920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:58.714690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:37249)
0807 15:23:58.714969 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:58.715028 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":111,"threads_started":1}
I20260807 15:23:58.751262 9921 raft_consensus.cc:482] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:23:58.751410 9921 raft_consensus.cc:504] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3572868ad79e47889c60347ea7ec9af3" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 40679 } } peers { permanent_uuid: "b70d709bee174d85a5acb23bee8d99e9" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42929 } } peers { permanent_uuid: "e327b51620884c2aa9b2d6bb8b3d2668" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 42971 } }
I20260807 15:23:58.751962 9921 leader_election.cc:288] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679), b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929)
W20260807 15:23:58.753067 9263 leader_election.cc:341] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3572868ad79e47889c60347ea7ec9af3 (127.15.242.194:40679): Not found: Tablet not found: bba59fc2f0364f9e88b6c7838b8706c9
W20260807 15:23:58.753212 9265 leader_election.cc:341] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b70d709bee174d85a5acb23bee8d99e9 (127.15.242.195:42929): Not found: Tablet not found: bba59fc2f0364f9e88b6c7838b8706c9
I20260807 15:23:58.753336 9265 leader_election.cc:302] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e327b51620884c2aa9b2d6bb8b3d2668; no voters: 3572868ad79e47889c60347ea7ec9af3, b70d709bee174d85a5acb23bee8d99e9
I20260807 15:23:58.753535 9921 raft_consensus.cc:2726] T bba59fc2f0364f9e88b6c7838b8706c9 P e327b51620884c2aa9b2d6bb8b3d2668 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 15:23:58.905359 9923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:58.904833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:43715)
0807 15:23:58.905136 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:58.905208 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":78,"threads_started":1}
I20260807 15:23:59.577464 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:59.577028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:47139)
0807 15:23:59.577303 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:59.577365 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":77,"threads_started":1}
I20260807 15:23:59.716500 9925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:59.716064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:37877)
0807 15:23:59.716345 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:59.716402 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":89,"threads_started":1}
I20260807 15:23:59.906730 9927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:23:59.906294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:58479)
0807 15:23:59.906555 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 15:23:59.906620 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":78,"threads_started":1}
I20260807 15:24:00.578805 9928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:00.578308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:57031)
0807 15:24:00.578641 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:00.578703 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":116,"threads_started":1}
I20260807 15:24:00.717831 9929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:00.717342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:34789)
0807 15:24:00.717643 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:00.717704 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":95,"threads_started":1}
I20260807 15:24:00.908236 9930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:00.907694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:35807)
0807 15:24:00.908061 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:00.908127 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":86,"threads_started":1}
I20260807 15:24:01.580214 9932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:01.579671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:50285)
0807 15:24:01.580014 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:01.580084 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":96,"threads_started":1}
I20260807 15:24:01.719319 9934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:01.718854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:46077)
0807 15:24:01.719143 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:01.719209 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":79,"threads_started":1}
I20260807 15:24:01.909685 9935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:01.909162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:40553)
0807 15:24:01.909516 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:01.909580 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":143,"threads_started":1}
I20260807 15:24:02.581852 9939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:02.581379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.193:46675)
0807 15:24:02.581681 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:02.581746 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":80,"threads_started":1}
I20260807 15:24:02.720739 9940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:02.720322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.194:44347)
0807 15:24:02.720573 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:02.720634 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":80,"threads_started":1}
I20260807 15:24:02.894367 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 9180
I20260807 15:24:02.910727 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 9449
I20260807 15:24:02.913301 9942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:02.910889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39455 (local address 127.15.242.195:42709)
0807 15:24:02.913063 (+ 2174us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:02.913148 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.254:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2055,"thread_start_us":81,"threads_started":1}
I20260807 15:24:02.921789 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 9651
2026-08-07T15:24:02Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59935 ms)
[----------] 30 tests from SecurityITest (258931 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:02 dist-test-slave-g170 krb5kdc[9946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:02 dist-test-slave-g170 krb5kdc[9946](info): set up 2 sockets
Aug 07 15:24:02 dist-test-slave-g170 krb5kdc[9946](info): commencing operation
krb5kdc: starting...
W20260807 15:24:04.222185 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:04 dist-test-slave-g170 krb5kdc[9946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:04.360256 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45743
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:33241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:45743
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:04.486406 9962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:04.486841 9962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:04.486948 9962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:04.492388 9962 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:04.492465 9962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:04.492486 9962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:04.492504 9962 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:04.492520 9962 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:04.498045 9962 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:45743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:04.499161 9962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:04.500161 9962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:04.509470 9971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:04.509464 9967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:04.509519 9962 server_base.cc:1034] running on GCE node
W20260807 15:24:04.509464 9968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:04.510375 9962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:04.511492 9962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:04.512683 9962 hybrid_clock.cc:648] HybridClock initialized: now 1786116244512651 us; error 41 us; skew 500 ppm
Aug 07 15:24:04 dist-test-slave-g170 krb5kdc[9946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116244, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:04.521727 9962 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:04.523447 9962 webserver.cc:460] Webserver started at http://127.15.242.254:34017/ using document root <none> and password file <none>
I20260807 15:24:04.524318 9962 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:04.524637 9962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:04.525012 9962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:04.528476 9962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "5eb8cc09373447be9674c000a97ebeb9"
format_stamp: "Formatted at 2026-08-07 15:24:04 on dist-test-slave-g170"
server_key: "12dc48f2757a029c195360f9b1afa06d"
server_key_iv: "1ba46fff941140bf80564857e4908cb9"
server_key_version: "encryptionkey@0"
I20260807 15:24:04.529444 9962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "5eb8cc09373447be9674c000a97ebeb9"
format_stamp: "Formatted at 2026-08-07 15:24:04 on dist-test-slave-g170"
server_key: "12dc48f2757a029c195360f9b1afa06d"
server_key_iv: "1ba46fff941140bf80564857e4908cb9"
server_key_version: "encryptionkey@0"
I20260807 15:24:04.535136 9962 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 15:24:04.538673 9984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:04.540393 9962 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:24:04.540536 9962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "5eb8cc09373447be9674c000a97ebeb9"
format_stamp: "Formatted at 2026-08-07 15:24:04 on dist-test-slave-g170"
server_key: "12dc48f2757a029c195360f9b1afa06d"
server_key_iv: "1ba46fff941140bf80564857e4908cb9"
server_key_version: "encryptionkey@0"
I20260807 15:24:04.540664 9962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:04.571261 9962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:04.574687 9962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:04.574903 9962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:04.582520 9962 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:45743
I20260807 15:24:04.582540 10069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:45743 every 8 connection(s)
I20260807 15:24:04.583500 9962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:04.586422 10072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:04.588641 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 9962
I20260807 15:24:04.588838 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:04.589166 16331 external_mini_cluster.cc:1428] Setting key 38f662d85f5028b633794ad39b858a47
I20260807 15:24:04.593014 10072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9: Bootstrap starting.
I20260807 15:24:04.596328 10072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:04.597424 10072 log.cc:824] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:04.601114 10072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9: No bootstrap required, opened a new log
Aug 07 15:24:04 dist-test-slave-g170 krb5kdc[9946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:04.606391 10072 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb8cc09373447be9674c000a97ebeb9" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45743 } }
I20260807 15:24:04.606789 10072 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:04.606905 10072 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb8cc09373447be9674c000a97ebeb9, State: Initialized, Role: FOLLOWER
I20260807 15:24:04.607565 10072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb8cc09373447be9674c000a97ebeb9" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45743 } }
I20260807 15:24:04.607820 10072 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:04.607944 10072 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:04.608119 10072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:04.609405 10072 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb8cc09373447be9674c000a97ebeb9" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45743 } }
I20260807 15:24:04.609790 10072 leader_election.cc:302] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5eb8cc09373447be9674c000a97ebeb9; no voters:
I20260807 15:24:04.610209 10072 leader_election.cc:288] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:04.610301 10078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:04.610492 10078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb8cc09373447be9674c000a97ebeb9, State: Running, Role: LEADER
I20260807 15:24:04.610615 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:04.591050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47726 (local address 127.15.242.254:45743)
0807 15:24:04.591563 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:04.591587 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:04.591636 (+ 49us) server_negotiation.cc:407] Connection header received
0807 15:24:04.592642 (+ 1006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:04.592669 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:04.593182 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:04.593592 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:04.595181 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:04.596872 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:04.598391 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:04.599251 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:04.599452 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:04.603321 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:04.603327 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:04.603340 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:04.603368 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:04.606717 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:04.607329 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:04.607334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:04.607339 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:04.607454 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:04.607774 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:04.607777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:04.607779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:04.608447 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:04.608662 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:04.609231 (+ 569us) server_negotiation.cc:299] Negotiation successful
0807 15:24:04.609562 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":148,"threads_started":1}
I20260807 15:24:04.610920 10078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb8cc09373447be9674c000a97ebeb9" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45743 } }
I20260807 15:24:04.611614 10072 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:04.613628 10080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5eb8cc09373447be9674c000a97ebeb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb8cc09373447be9674c000a97ebeb9" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45743 } } }
I20260807 15:24:04.613830 10080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:04.614061 10079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5eb8cc09373447be9674c000a97ebeb9. Latest consensus state: current_term: 1 leader_uuid: "5eb8cc09373447be9674c000a97ebeb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb8cc09373447be9674c000a97ebeb9" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45743 } } }
I20260807 15:24:04.614153 10079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9 [sys.catalog]: This master's current role is: LEADER
W20260807 15:24:04.616982 10100 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:04.617110 10100 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:04.617202 10098 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:04.617920 10098 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:04.624426 10098 catalog_manager.cc:1347] Generated new cluster ID: 38121e40b9e145dd81144434ea2ec32b
I20260807 15:24:04.624505 10098 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:04.632599 10098 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:04.633571 10098 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:04.638664 10098 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9: Generated new TSK 0
I20260807 15:24:04.639529 10098 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:24:04.670018 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45743
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:33241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:04.787683 10109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:04.787964 10109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:04.788007 10109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:04.792158 10109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:04.792235 10109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:04.792294 10109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:24:04.797920 10109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:04.799072 10109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:04.800158 10109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:04.810415 10121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:04.810386 10119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:04.810386 10118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:04.810969 10109 server_base.cc:1034] running on GCE node
I20260807 15:24:04.811442 10109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:04.812237 10109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:04.813468 10109 hybrid_clock.cc:648] HybridClock initialized: now 1786116244813433 us; error 51 us; skew 500 ppm
Aug 07 15:24:04 dist-test-slave-g170 krb5kdc[9946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116244, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:04.816895 10109 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:24:04.817894 10109 webserver.cc:460] Webserver started at http://127.15.242.193:40951/ using document root <none> and password file <none>
I20260807 15:24:04.818540 10109 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:04.818609 10109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:04.818856 10109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:04.821300 10109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "a3facdf9787b4622b906c4593fe06962"
format_stamp: "Formatted at 2026-08-07 15:24:04 on dist-test-slave-g170"
server_key: "2d6d9d04bf2a77612d121cc2201356e5"
server_key_iv: "c4f9634ffbfa41760931c3358d98bba5"
server_key_version: "encryptionkey@0"
I20260807 15:24:04.821904 10109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "a3facdf9787b4622b906c4593fe06962"
format_stamp: "Formatted at 2026-08-07 15:24:04 on dist-test-slave-g170"
server_key: "2d6d9d04bf2a77612d121cc2201356e5"
server_key_iv: "c4f9634ffbfa41760931c3358d98bba5"
server_key_version: "encryptionkey@0"
I20260807 15:24:04.826303 10109 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:24:04.829110 10132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:04.830601 10109 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:24:04.830821 10109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "a3facdf9787b4622b906c4593fe06962"
format_stamp: "Formatted at 2026-08-07 15:24:04 on dist-test-slave-g170"
server_key: "2d6d9d04bf2a77612d121cc2201356e5"
server_key_iv: "c4f9634ffbfa41760931c3358d98bba5"
server_key_version: "encryptionkey@0"
I20260807 15:24:04.830955 10109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:04.856453 10109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:04.860464 10109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:04.860709 10109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:04.861433 10109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:04.862350 10109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:04.862399 10109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:04.862443 10109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:04.862459 10109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:04.873353 10109 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:46265
I20260807 15:24:04.873492 10311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:46265 every 8 connection(s)
I20260807 15:24:04.874451 10109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:24:04.877774 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 10109
I20260807 15:24:04.877931 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:24:04.878283 16331 external_mini_cluster.cc:1428] Setting key 0747b72e95005d4b073836e80a397ccf
Aug 07 15:24:04 dist-test-slave-g170 krb5kdc[9946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116244, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:24:04.892539 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:04.876628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:51689 (local address 127.15.242.254:45743)
0807 15:24:04.876882 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:04.876885 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:04.878000 (+ 1115us) server_negotiation.cc:407] Connection header received
0807 15:24:04.879677 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:04.879681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:04.879763 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:04.879849 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:04.881848 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:04.882589 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:04.884068 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:04.884497 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:04.884629 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:04.887864 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:04.887871 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:04.887874 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:04.887907 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:04.889809 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:04.890420 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:04.890424 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:04.890426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:04.890528 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:04.891090 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:04.891093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:04.891094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:04.891310 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:04.891401 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:04.892195 (+ 794us) server_negotiation.cc:299] Negotiation successful
0807 15:24:04.892388 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:24:04.893674 10317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:04.877108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45743 (local address 127.15.242.193:51689)
0807 15:24:04.877805 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:04.877876 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:04.879422 (+ 1546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:04.880296 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:04.880306 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:04.880916 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:04.881675 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:04.881700 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:04.882739 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:04.882742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:04.883927 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:04.883939 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:04.884710 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:04.884714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:04.884951 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:04.885654 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:04.885684 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:04.887620 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:04.889972 (+ 2352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:04.889977 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:04.889992 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:04.890287 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:04.890649 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:04.890651 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:04.890653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:04.890946 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:04.891422 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:04.891428 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:04.891856 (+ 428us) client_negotiation.cc:769] Sending connection context
0807 15:24:04.892072 (+ 216us) client_negotiation.cc:240] Negotiation successful
0807 15:24:04.892506 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":141,"threads_started":1}
I20260807 15:24:04.895207 10312 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45743
I20260807 15:24:04.895504 10312 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:04.896060 10312 heartbeater.cc:511] Master 127.15.242.254:45743 requested a full tablet report, sending...
I20260807 15:24:04.897826 10014 ts_manager.cc:194] Registered new tserver with Master: a3facdf9787b4622b906c4593fe06962 (127.15.242.193:46265)
I20260807 15:24:04.899035 10014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:51689
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:24:04.912976 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45743
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:33241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:05.040657 10324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:05.041018 10324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:05.041071 10324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:05.045568 10324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:05.045640 10324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:05.045706 10324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:24:05.051735 10324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:05.052903 10324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:05.054006 10324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:05.064682 10332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:05.064894 10324 server_base.cc:1034] running on GCE node
W20260807 15:24:05.064831 10331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:05.064694 10335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:05.065478 10324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:05.066180 10324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:05.067355 10324 hybrid_clock.cc:648] HybridClock initialized: now 1786116245067338 us; error 31 us; skew 500 ppm
Aug 07 15:24:05 dist-test-slave-g170 krb5kdc[9946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116245, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:05.070493 10324 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:24:05.071419 10324 webserver.cc:460] Webserver started at http://127.15.242.194:38971/ using document root <none> and password file <none>
I20260807 15:24:05.071990 10324 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:05.072057 10324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:05.072244 10324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:05.074692 10324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "948c2f1b2121403b8ded0bbb26f3b1c2"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "b170630ddf30c9118fc8ac71d97703c0"
server_key_iv: "3517281dd0a7a8e81e2766b1b1303acb"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.075253 10324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "948c2f1b2121403b8ded0bbb26f3b1c2"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "b170630ddf30c9118fc8ac71d97703c0"
server_key_iv: "3517281dd0a7a8e81e2766b1b1303acb"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.079218 10324 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 15:24:05.082036 10345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:05.083457 10324 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:05.083614 10324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "948c2f1b2121403b8ded0bbb26f3b1c2"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "b170630ddf30c9118fc8ac71d97703c0"
server_key_iv: "3517281dd0a7a8e81e2766b1b1303acb"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.083725 10324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:05.103984 10324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:05.107630 10324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:05.107856 10324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:05.108515 10324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:05.109480 10324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:05.109534 10324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:05.109629 10324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:05.109669 10324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:05.119939 10324 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:42703
I20260807 15:24:05.120000 10516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:42703 every 8 connection(s)
I20260807 15:24:05.121106 10324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:24:05.121944 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 10324
I20260807 15:24:05.122093 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:24:05.122418 16331 external_mini_cluster.cc:1428] Setting key 9b5a4927f51ae33ba5e2865bf35d29ea
Aug 07 15:24:05 dist-test-slave-g170 krb5kdc[9946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116245, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:24:05.137732 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.123196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:43839 (local address 127.15.242.254:45743)
0807 15:24:05.123861 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.123866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.124491 (+ 625us) server_negotiation.cc:407] Connection header received
0807 15:24:05.126076 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.126083 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.126149 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.126248 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:05.128102 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.128697 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.130086 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.130521 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.130665 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.133504 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:05.133508 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:05.133510 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:05.133536 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:05.135389 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:05.135984 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:05.135987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:05.135988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:05.136066 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:05.136423 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:05.136428 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:05.136430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:05.136625 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:05.136735 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.137351 (+ 616us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.137496 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:24:05.138700 10524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.123731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45743 (local address 127.15.242.194:43839)
0807 15:24:05.124331 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:05.124378 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:05.125854 (+ 1476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:05.126505 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:05.126517 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:05.127096 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:05.127914 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.127939 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.128908 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.128911 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.129936 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.129948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.130703 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.130707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.130865 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.131575 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:05.131594 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:05.133316 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:05.135534 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:05.135541 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:05.135557 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:05.135844 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:05.136172 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:05.136175 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:05.136177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:05.136325 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:05.136735 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:05.136743 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:05.137055 (+ 312us) client_negotiation.cc:769] Sending connection context
0807 15:24:05.137288 (+ 233us) client_negotiation.cc:240] Negotiation successful
0807 15:24:05.137643 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":140,"threads_started":1}
I20260807 15:24:05.140175 10518 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45743
I20260807 15:24:05.140475 10518 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:05.141085 10518 heartbeater.cc:511] Master 127.15.242.254:45743 requested a full tablet report, sending...
I20260807 15:24:05.142227 10014 ts_manager.cc:194] Registered new tserver with Master: 948c2f1b2121403b8ded0bbb26f3b1c2 (127.15.242.194:42703)
I20260807 15:24:05.142832 10014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:43839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:24:05.156312 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45743
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:33241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:05.285138 10529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:05.285424 10529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:05.285473 10529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:05.289693 10529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:05.289754 10529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:05.289813 10529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:24:05.295104 10529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:45743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:05.296162 10529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:05.297515 10529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:05.307964 10545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:05.308045 10540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:05.307965 10537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:05.308471 10529 server_base.cc:1034] running on GCE node
I20260807 15:24:05.308938 10529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:05.309592 10529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:05.310767 10529 hybrid_clock.cc:648] HybridClock initialized: now 1786116245310752 us; error 28 us; skew 500 ppm
Aug 07 15:24:05 dist-test-slave-g170 krb5kdc[9946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116245, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:05.314180 10529 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:24:05.315193 10529 webserver.cc:460] Webserver started at http://127.15.242.195:45955/ using document root <none> and password file <none>
I20260807 15:24:05.315824 10529 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:05.315892 10529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:05.316165 10529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:05.318485 10529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "7dec57832598483caad37e641c5efd24"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "7aeb528e72e6ff5c78fef425785aeb94"
server_key_iv: "b9cb72620d2786c4240f3fca17f5a49d"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.319105 10529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "7dec57832598483caad37e641c5efd24"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "7aeb528e72e6ff5c78fef425785aeb94"
server_key_iv: "b9cb72620d2786c4240f3fca17f5a49d"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.323400 10529 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 15:24:05.326391 10554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:05.328063 10529 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:24:05.328209 10529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "7dec57832598483caad37e641c5efd24"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "7aeb528e72e6ff5c78fef425785aeb94"
server_key_iv: "b9cb72620d2786c4240f3fca17f5a49d"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.328341 10529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:05.344058 10529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:05.347541 10529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:05.347812 10529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:05.348507 10529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:05.349496 10529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:05.349547 10529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:05.349588 10529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:05.349604 10529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:05.359192 10529 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:38191
I20260807 15:24:05.359236 10722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:38191 every 8 connection(s)
I20260807 15:24:05.360116 10529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:24:05.365904 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 10529
I20260807 15:24:05.366051 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:24:05.366418 16331 external_mini_cluster.cc:1428] Setting key 50c178a458ccd57652d4de0f5270c1be
Aug 07 15:24:05 dist-test-slave-g170 krb5kdc[9946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116245, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:05.382963 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.362083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:39855 (local address 127.15.242.254:45743)
0807 15:24:05.362251 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.362255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.369544 (+ 7289us) server_negotiation.cc:407] Connection header received
0807 15:24:05.370995 (+ 1451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.371001 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.371073 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.371184 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:05.372417 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.373386 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.374570 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.375009 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.375154 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.378442 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:05.378448 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:05.378453 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:05.378490 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:05.380388 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:05.381134 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:05.381140 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:05.381143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:05.381258 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:05.381647 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:05.381652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:05.381656 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:05.381933 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:05.382044 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.382571 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.382729 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 15:24:05.383663 10727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.362654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45743 (local address 127.15.242.195:39855)
0807 15:24:05.369371 (+ 6717us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:05.369442 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:05.370771 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:05.371377 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:05.371385 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:05.371763 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:05.372276 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.372289 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.373524 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.373532 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.374445 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.374456 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.375184 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.375206 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.375356 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.376273 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:05.376291 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:05.378224 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:05.380648 (+ 2424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:05.380654 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:05.380672 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:05.381023 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:05.381368 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:05.381372 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:05.381374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:05.381540 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:05.382035 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:05.382040 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:05.382306 (+ 266us) client_negotiation.cc:769] Sending connection context
0807 15:24:05.382462 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 15:24:05.382743 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6420,"thread_start_us":161,"threads_started":1}
I20260807 15:24:05.384966 10725 heartbeater.cc:347] Connected to a master server at 127.15.242.254:45743
I20260807 15:24:05.385281 10725 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:05.385926 10725 heartbeater.cc:511] Master 127.15.242.254:45743 requested a full tablet report, sending...
I20260807 15:24:05.387106 10014 ts_manager.cc:194] Registered new tserver with Master: 7dec57832598483caad37e641c5efd24 (127.15.242.195:38191)
I20260807 15:24:05.387732 10014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:39855
I20260807 15:24:05.393139 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:24:05.403983 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.395262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47742 (local address 127.15.242.254:45743)
0807 15:24:05.395410 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.395417 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.395565 (+ 148us) server_negotiation.cc:407] Connection header received
0807 15:24:05.395655 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.395661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.395717 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.395814 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:05.396451 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.397409 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.398242 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.398690 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.398821 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.400156 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:05.400164 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:05.400168 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:05.400208 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:05.401984 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:05.402410 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:05.402416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:05.402420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:05.402526 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:05.402840 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:05.402846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:05.402850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:05.403222 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:05.403385 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.403601 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.403746 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 15:24:05.407262 10014 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:24:05.413141 10014 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:24:05.431272 10744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.424177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:38191 (local address 127.0.0.1:38340)
0807 15:24:05.424633 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:05.424680 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:05.424855 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:05.426319 (+ 1464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:05.426325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:05.426350 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:05.426515 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.426526 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.427973 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.427977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.429835 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.429845 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.430695 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.430699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.430817 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.430882 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 15:24:05.430994 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 15:24:05.431114 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":3,"thread_start_us":92,"threads_started":1}
I20260807 15:24:05.432665 10747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.425040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.15.242.195:38191)
0807 15:24:05.425756 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.425770 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.425795 (+ 25us) server_negotiation.cc:407] Connection header received
0807 15:24:05.425880 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.425886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.426158 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.426332 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:05.426675 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.427822 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.429971 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.430562 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.430707 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.430856 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.432340 (+ 1484us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.432506 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":133,"threads_started":1}
I20260807 15:24:05.432775 10740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.424190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:42703 (local address 127.0.0.1:42272)
0807 15:24:05.425073 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:05.425088 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:05.425190 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:05.427164 (+ 1974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:05.427167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:05.427188 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:05.427301 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.427307 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.428783 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.428787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.430443 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.430459 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.432234 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.432241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.432371 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.432411 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 15:24:05.432468 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 15:24:05.432542 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"mutex_wait_us":47,"thread_start_us":146,"threads_started":1}
I20260807 15:24:05.433992 10745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.424975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:46265 (local address 127.0.0.1:49124)
0807 15:24:05.425265 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:05.425279 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:05.425360 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:05.427041 (+ 1681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:05.427046 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:05.427073 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:05.427252 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.427262 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.428987 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.428992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.432201 (+ 3209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.432214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.433451 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.433454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.433554 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.433576 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 15:24:05.433681 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 15:24:05.433781 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":96,"thread_start_us":116,"threads_started":1}
I20260807 15:24:05.434551 10749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.425897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49124 (local address 127.15.242.193:46265)
0807 15:24:05.426305 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.426314 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.426344 (+ 30us) server_negotiation.cc:407] Connection header received
0807 15:24:05.426439 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.426452 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.426678 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.426860 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:05.427417 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.428833 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.432350 (+ 3517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.433324 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.433464 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.433601 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.434208 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.434346 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":74,"threads_started":1}
I20260807 15:24:05.436069 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 58b3e4b32bb04dafb86a029edcb099fe (DEFAULT_TABLE table=test-table [id=aa339772392945b0bd4d12bbcb5dc6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:05.437279 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b3e4b32bb04dafb86a029edcb099fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:05.437975 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.425462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42272 (local address 127.15.242.194:42703)
0807 15:24:05.426687 (+ 1225us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.426701 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.426723 (+ 22us) server_negotiation.cc:407] Connection header received
0807 15:24:05.426798 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.426803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.426990 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.427453 (+ 463us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:05.427605 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.428611 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.430882 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.431951 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.433272 (+ 1321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.433410 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.433463 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.433555 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1105,"thread_start_us":155,"threads_started":1}
I20260807 15:24:05.440138 10207 tablet_service.cc:1467] Processing CreateTablet for tablet 58b3e4b32bb04dafb86a029edcb099fe (DEFAULT_TABLE table=test-table [id=aa339772392945b0bd4d12bbcb5dc6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:05.441511 10207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b3e4b32bb04dafb86a029edcb099fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:05.441558 10419 tablet_service.cc:1467] Processing CreateTablet for tablet 58b3e4b32bb04dafb86a029edcb099fe (DEFAULT_TABLE table=test-table [id=aa339772392945b0bd4d12bbcb5dc6d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:05.442926 10419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b3e4b32bb04dafb86a029edcb099fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:05.450394 10751 tablet_bootstrap.cc:492] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962: Bootstrap starting.
I20260807 15:24:05.451399 10750 tablet_bootstrap.cc:492] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: Bootstrap starting.
I20260807 15:24:05.453069 10751 tablet_bootstrap.cc:654] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:05.454430 10751 log.cc:824] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:05.454890 10750 tablet_bootstrap.cc:654] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:05.456161 10750 log.cc:824] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:05.456938 10751 tablet_bootstrap.cc:492] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962: No bootstrap required, opened a new log
I20260807 15:24:05.456969 10752 tablet_bootstrap.cc:492] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: Bootstrap starting.
I20260807 15:24:05.457219 10751 ts_tablet_manager.cc:1397] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:24:05.458508 10750 tablet_bootstrap.cc:492] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: No bootstrap required, opened a new log
I20260807 15:24:05.458814 10750 ts_tablet_manager.cc:1397] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 15:24:05.461560 10752 tablet_bootstrap.cc:654] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:05.462142 10751 raft_consensus.cc:348] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.462568 10751 raft_consensus.cc:374] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:05.462674 10751 raft_consensus.cc:729] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3facdf9787b4622b906c4593fe06962, State: Initialized, Role: FOLLOWER
I20260807 15:24:05.463191 10752 log.cc:824] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:05.463287 10751 consensus_queue.cc:260] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.464541 10751 ts_tablet_manager.cc:1428] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:24:05.464399 10750 raft_consensus.cc:348] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.464748 10750 raft_consensus.cc:374] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:05.464898 10750 raft_consensus.cc:729] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dec57832598483caad37e641c5efd24, State: Initialized, Role: FOLLOWER
I20260807 15:24:05.465039 10312 heartbeater.cc:503] Master 127.15.242.254:45743 was elected leader, sending a full tablet report...
I20260807 15:24:05.465441 10750 consensus_queue.cc:260] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.465803 10752 tablet_bootstrap.cc:492] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: No bootstrap required, opened a new log
I20260807 15:24:05.466017 10752 ts_tablet_manager.cc:1397] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 15:24:05.466444 10750 ts_tablet_manager.cc:1428] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: Time spent starting tablet: real 0.007s user 0.000s sys 0.005s
I20260807 15:24:05.466799 10725 heartbeater.cc:503] Master 127.15.242.254:45743 was elected leader, sending a full tablet report...
I20260807 15:24:05.471731 10752 raft_consensus.cc:348] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.472095 10752 raft_consensus.cc:374] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:05.472172 10752 raft_consensus.cc:729] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 948c2f1b2121403b8ded0bbb26f3b1c2, State: Initialized, Role: FOLLOWER
I20260807 15:24:05.472743 10752 consensus_queue.cc:260] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.473609 10518 heartbeater.cc:503] Master 127.15.242.254:45743 was elected leader, sending a full tablet report...
I20260807 15:24:05.474140 10752 ts_tablet_manager.cc:1428] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: Time spent starting tablet: real 0.008s user 0.006s sys 0.003s
I20260807 15:24:05.489233 10757 raft_consensus.cc:482] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:24:05.489491 10757 raft_consensus.cc:504] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.490757 10757 leader_election.cc:288] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 948c2f1b2121403b8ded0bbb26f3b1c2 (127.15.242.194:42703), 7dec57832598483caad37e641c5efd24 (127.15.242.195:38191)
I20260807 15:24:05.495419 10747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.491184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:54329 (local address 127.15.242.195:38191)
0807 15:24:05.491418 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.491425 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.491491 (+ 66us) server_negotiation.cc:407] Connection header received
0807 15:24:05.491681 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.491686 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.491748 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.491831 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:05.492259 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.493069 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.494324 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.494843 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.494971 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.495030 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.495211 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.495286 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 15:24:05.495436 10762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.491018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:38191 (local address 127.15.242.193:54329)
0807 15:24:05.491396 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:05.491412 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:05.491544 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:05.491873 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:05.491879 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:05.491911 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:05.492102 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.492112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.493208 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.493212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.494198 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.494212 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.494962 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.494966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.495077 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.495107 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 15:24:05.495193 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 15:24:05.495263 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":1,"thread_start_us":159,"threads_started":1}
I20260807 15:24:05.496167 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b3e4b32bb04dafb86a029edcb099fe" candidate_uuid: "a3facdf9787b4622b906c4593fe06962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dec57832598483caad37e641c5efd24" is_pre_election: true
I20260807 15:24:05.496510 10655 raft_consensus.cc:2454] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3facdf9787b4622b906c4593fe06962 in term 0.
I20260807 15:24:05.497095 10133 leader_election.cc:302] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dec57832598483caad37e641c5efd24, a3facdf9787b4622b906c4593fe06962; no voters:
I20260807 15:24:05.497246 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.491225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:50837 (local address 127.15.242.194:42703)
0807 15:24:05.491442 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.491449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.491904 (+ 455us) server_negotiation.cc:407] Connection header received
0807 15:24:05.492101 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.492104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.492154 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.492239 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:05.492654 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.493444 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.495455 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.496290 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.496415 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.496491 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.497023 (+ 532us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.497126 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260807 15:24:05.497454 10757 raft_consensus.cc:2781] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:24:05.497466 10763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.491030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:42703 (local address 127.15.242.193:50837)
0807 15:24:05.491824 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:05.491837 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:05.491994 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:05.492364 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:05.492367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:05.492384 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:05.492495 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.492501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.493676 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.493680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.495284 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:05.495299 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.496613 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.496618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:05.496809 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.496845 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 15:24:05.496988 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 15:24:05.497083 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":408,"thread_start_us":181,"threads_started":1}
I20260807 15:24:05.497529 10757 raft_consensus.cc:482] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:24:05.497561 10757 raft_consensus.cc:3037] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:05.498217 10450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b3e4b32bb04dafb86a029edcb099fe" candidate_uuid: "a3facdf9787b4622b906c4593fe06962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" is_pre_election: true
I20260807 15:24:05.498528 10450 raft_consensus.cc:2454] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3facdf9787b4622b906c4593fe06962 in term 0.
I20260807 15:24:05.499024 10757 raft_consensus.cc:504] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.499387 10757 leader_election.cc:288] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [CANDIDATE]: Term 1 election: Requested vote from peers 948c2f1b2121403b8ded0bbb26f3b1c2 (127.15.242.194:42703), 7dec57832598483caad37e641c5efd24 (127.15.242.195:38191)
I20260807 15:24:05.499697 10450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b3e4b32bb04dafb86a029edcb099fe" candidate_uuid: "a3facdf9787b4622b906c4593fe06962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2"
I20260807 15:24:05.499809 10450 raft_consensus.cc:3037] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:05.499833 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b3e4b32bb04dafb86a029edcb099fe" candidate_uuid: "a3facdf9787b4622b906c4593fe06962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dec57832598483caad37e641c5efd24"
I20260807 15:24:05.499987 10655 raft_consensus.cc:3037] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:05.500919 10450 raft_consensus.cc:2454] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3facdf9787b4622b906c4593fe06962 in term 1.
I20260807 15:24:05.501261 10135 leader_election.cc:302] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 948c2f1b2121403b8ded0bbb26f3b1c2, a3facdf9787b4622b906c4593fe06962; no voters:
I20260807 15:24:05.501461 10757 raft_consensus.cc:2781] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:05.501715 10757 raft_consensus.cc:686] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 1 LEADER]: Becoming Leader. State: Replica: a3facdf9787b4622b906c4593fe06962, State: Running, Role: LEADER
I20260807 15:24:05.501780 10655 raft_consensus.cc:2454] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3facdf9787b4622b906c4593fe06962 in term 1.
I20260807 15:24:05.502079 10757 consensus_queue.cc:237] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } }
I20260807 15:24:05.505519 10012 catalog_manager.cc:5495] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3facdf9787b4622b906c4593fe06962 (127.15.242.193). New cstate: current_term: 1 leader_uuid: "a3facdf9787b4622b906c4593fe06962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3facdf9787b4622b906c4593fe06962" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 46265 } health_report { overall_health: HEALTHY } } }
I20260807 15:24:05.520190 10749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.515337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49126 (local address 127.15.242.193:46265)
0807 15:24:05.515489 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.515496 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.515516 (+ 20us) server_negotiation.cc:407] Connection header received
0807 15:24:05.515645 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.515649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.515736 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.515878 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:05.516153 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.517119 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.518062 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.518515 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.518651 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.519048 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:05.519685 (+ 637us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:05.519822 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.519897 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.519979 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 15:24:05.527591 10450 raft_consensus.cc:1261] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 1 FOLLOWER]: Refusing update from remote peer a3facdf9787b4622b906c4593fe06962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:05.527732 10655 raft_consensus.cc:1261] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 1 FOLLOWER]: Refusing update from remote peer a3facdf9787b4622b906c4593fe06962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:05.528429 10764 consensus_queue.cc:1035] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dec57832598483caad37e641c5efd24" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 38191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:05.528692 10757 consensus_queue.cc:1035] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "948c2f1b2121403b8ded0bbb26f3b1c2" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:05.536856 10771 mvcc.cc:205] Tried to move back new op lower bound from 7315932141673611264 to 7315932141579468800. Current Snapshot: MvccSnapshot[applied={T|T < 7315932141673611264}]
I20260807 15:24:05.541585 10772 mvcc.cc:205] Tried to move back new op lower bound from 7315932141673611264 to 7315932141579468800. Current Snapshot: MvccSnapshot[applied={T|T < 7315932141673611264 or (T in {7315932141673611264})}]
I20260807 15:24:05.543020 10773 mvcc.cc:205] Tried to move back new op lower bound from 7315932141673611264 to 7315932141579468800. Current Snapshot: MvccSnapshot[applied={T|T < 7315932141673611264}]
I20260807 15:24:05.551015 10011 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:05.551221 10011 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:05.554445 10011 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5eb8cc09373447be9674c000a97ebeb9: Sending DeleteTablet for 3 replicas of tablet 58b3e4b32bb04dafb86a029edcb099fe
I20260807 15:24:05.555544 10207 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b3e4b32bb04dafb86a029edcb099fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:05 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:49124
I20260807 15:24:05.555565 10419 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b3e4b32bb04dafb86a029edcb099fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:05 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:42272
I20260807 15:24:05.556155 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b3e4b32bb04dafb86a029edcb099fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:05 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:38340
I20260807 15:24:05.556383 10787 tablet_replica.cc:330] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962: stopping tablet replica
I20260807 15:24:05.556697 10787 raft_consensus.cc:2229] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:24:05.557111 10789 tablet_replica.cc:330] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: stopping tablet replica
I20260807 15:24:05.557209 10787 raft_consensus.cc:2258] T 58b3e4b32bb04dafb86a029edcb099fe P a3facdf9787b4622b906c4593fe06962 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:05.557512 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 10109
I20260807 15:24:05.558511 10789 raft_consensus.cc:2229] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:24:05.558688 10788 tablet_replica.cc:330] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: stopping tablet replica
I20260807 15:24:05.558909 10789 raft_consensus.cc:2258] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:05.558976 10788 raft_consensus.cc:2229] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:24:05.559284 10788 raft_consensus.cc:2258] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:05.561685 10789 ts_tablet_manager.cc:1905] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:05.565202 10789 ts_tablet_manager.cc:1918] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:05.565315 10789 log.cc:1196] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/58b3e4b32bb04dafb86a029edcb099fe
I20260807 15:24:05.565697 10789 ts_tablet_manager.cc:1939] T 58b3e4b32bb04dafb86a029edcb099fe P 7dec57832598483caad37e641c5efd24: Deleting consensus metadata
I20260807 15:24:05.565956 10788 ts_tablet_manager.cc:1905] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:05.567242 9985 catalog_manager.cc:4841] TS 7dec57832598483caad37e641c5efd24 (127.15.242.195:38191): tablet 58b3e4b32bb04dafb86a029edcb099fe (table test-table [id=aa339772392945b0bd4d12bbcb5dc6d0]) successfully deleted
I20260807 15:24:05.568483 10788 ts_tablet_manager.cc:1918] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:05.568598 10788 log.cc:1196] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/58b3e4b32bb04dafb86a029edcb099fe
I20260807 15:24:05.568972 10788 ts_tablet_manager.cc:1939] T 58b3e4b32bb04dafb86a029edcb099fe P 948c2f1b2121403b8ded0bbb26f3b1c2: Deleting consensus metadata
I20260807 15:24:05.570012 9987 catalog_manager.cc:4841] TS 948c2f1b2121403b8ded0bbb26f3b1c2 (127.15.242.194:42703): tablet 58b3e4b32bb04dafb86a029edcb099fe (table test-table [id=aa339772392945b0bd4d12bbcb5dc6d0]) successfully deleted
W20260807 15:24:05.572050 9987 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:46265 (error 108)
I20260807 15:24:05.572948 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 10324
I20260807 15:24:05.573235 10745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.572832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:46265 (local address 127.0.0.1:49134)
0807 15:24:05.573033 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:05.573118 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:46265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260807 15:24:05.585253 9987 catalog_manager.cc:4584] TS a3facdf9787b4622b906c4593fe06962 (127.15.242.193:46265): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 58b3e4b32bb04dafb86a029edcb099fe: Network error: Client connection negotiation failed: client connection to 127.15.242.193:46265: connect: Connection refused (error 111)
I20260807 15:24:05.589947 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 10529
I20260807 15:24:05.601061 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 9962
2026-08-07T15:24:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2677 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T15:24:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:05Z Disabled control of system clock
I20260807 15:24:05.639225 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39707
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:46801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:39707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 15:24:05.755983 10798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:05.756254 10798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:05.756290 10798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:05.760298 10798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:05.760356 10798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:05.760372 10798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:05.760389 10798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:05.760404 10798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:05.765202 10798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:39707
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:05.766256 10798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:05.767686 10798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:05.776746 10806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:05.776988 10798 server_base.cc:1034] running on GCE node
W20260807 15:24:05.776746 10805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:05.776871 10809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:05.777667 10798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:05.778841 10798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:05.780036 10798 hybrid_clock.cc:648] HybridClock initialized: now 1786116245780003 us; error 44 us; skew 500 ppm
I20260807 15:24:05.782105 10798 webserver.cc:460] Webserver started at http://127.15.242.254:36719/ using document root <none> and password file <none>
I20260807 15:24:05.782692 10798 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:05.782766 10798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:05.783041 10798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:05.785243 10798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "3cdf30045bbc4f51a926c640b42baad2"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "7aca0151a7a913505086faaf917df89e"
server_key_iv: "3144649fe7e9d76c13901fa9e43abccc"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.785825 10798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "3cdf30045bbc4f51a926c640b42baad2"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "7aca0151a7a913505086faaf917df89e"
server_key_iv: "3144649fe7e9d76c13901fa9e43abccc"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.789510 10798 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:05.791944 10819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:05.793174 10798 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:24:05.793309 10798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "3cdf30045bbc4f51a926c640b42baad2"
format_stamp: "Formatted at 2026-08-07 15:24:05 on dist-test-slave-g170"
server_key: "7aca0151a7a913505086faaf917df89e"
server_key_iv: "3144649fe7e9d76c13901fa9e43abccc"
server_key_version: "encryptionkey@0"
I20260807 15:24:05.793416 10798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:05.810220 10798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:05.810953 10798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:05.811162 10798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:05.818409 10798 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:39707
I20260807 15:24:05.818441 10894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:39707 every 8 connection(s)
I20260807 15:24:05.819387 10798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:05.822846 10898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:05.825834 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 10798
I20260807 15:24:05.825996 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:05.826284 16331 external_mini_cluster.cc:1428] Setting key 50e02b7b8d83397a7aacd085bb57d2b4
I20260807 15:24:05.829118 10898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2: Bootstrap starting.
I20260807 15:24:05.831384 10898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:05.832147 10898 log.cc:824] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:05.834132 10898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2: No bootstrap required, opened a new log
I20260807 15:24:05.835966 10902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:05.827815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49168 (local address 127.15.242.254:39707)
0807 15:24:05.828524 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:05.828541 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:05.828578 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:24:05.829287 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:05.829307 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:05.829782 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:05.830124 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:05.830586 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.831614 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.832572 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:05.833131 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:05.833307 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:05.834174 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:05.834180 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:05.834194 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:05.834643 (+ 449us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:05.834710 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:05.834732 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:05.834841 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:05.834973 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 15:24:05.835247 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":131,"threads_started":1}
I20260807 15:24:05.838248 10898 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cdf30045bbc4f51a926c640b42baad2" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39707 } }
I20260807 15:24:05.838578 10898 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:05.838673 10898 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cdf30045bbc4f51a926c640b42baad2, State: Initialized, Role: FOLLOWER
I20260807 15:24:05.839133 10898 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cdf30045bbc4f51a926c640b42baad2" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39707 } }
I20260807 15:24:05.839295 10898 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:05.839380 10898 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:05.839497 10898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:05.840524 10898 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cdf30045bbc4f51a926c640b42baad2" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39707 } }
I20260807 15:24:05.840945 10898 leader_election.cc:302] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cdf30045bbc4f51a926c640b42baad2; no voters:
I20260807 15:24:05.841293 10898 leader_election.cc:288] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:05.841429 10904 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:05.841696 10904 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [term 1 LEADER]: Becoming Leader. State: Replica: 3cdf30045bbc4f51a926c640b42baad2, State: Running, Role: LEADER
I20260807 15:24:05.842110 10904 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cdf30045bbc4f51a926c640b42baad2" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39707 } }
I20260807 15:24:05.842636 10898 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:05.844076 10905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cdf30045bbc4f51a926c640b42baad2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cdf30045bbc4f51a926c640b42baad2" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39707 } } }
I20260807 15:24:05.844240 10905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:05.844399 10906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cdf30045bbc4f51a926c640b42baad2. Latest consensus state: current_term: 1 leader_uuid: "3cdf30045bbc4f51a926c640b42baad2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cdf30045bbc4f51a926c640b42baad2" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39707 } } }
I20260807 15:24:05.844513 10906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:05.844923 10917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:05.847986 10917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:05.853641 10917 catalog_manager.cc:1347] Generated new cluster ID: ab172378d747409f8fdcab4e40d8f0b8
I20260807 15:24:05.853734 10917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:05.882350 10917 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:05.883725 10917 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:05.889950 10917 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2: Generated new TSK 0
I20260807 15:24:05.890799 10917 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:05.897696 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39707
--builtin_ntp_servers=127.15.242.212:46801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 15:24:06.023037 10935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:06.023350 10935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:06.023418 10935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:06.027709 10935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:06.027791 10935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:06.027876 10935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:24:06.032816 10935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:06.033974 10935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:06.035467 10935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:06.045425 10941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:06.045557 10944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:06.045473 10942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:06.045686 10935 server_base.cc:1034] running on GCE node
I20260807 15:24:06.046249 10935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:06.046901 10935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:06.048091 10935 hybrid_clock.cc:648] HybridClock initialized: now 1786116246048074 us; error 29 us; skew 500 ppm
I20260807 15:24:06.049988 10935 webserver.cc:460] Webserver started at http://127.15.242.193:40033/ using document root <none> and password file <none>
I20260807 15:24:06.050580 10935 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:06.050684 10935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:06.050925 10935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:06.053056 10935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "1137104373844f578d8f35e9a5e737f4"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "dbfe6ccbbeaa307eea2afaa7de155008"
server_key_iv: "3ac17a36a85ccf665e7b6bb5c4b69997"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.053638 10935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "1137104373844f578d8f35e9a5e737f4"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "dbfe6ccbbeaa307eea2afaa7de155008"
server_key_iv: "3ac17a36a85ccf665e7b6bb5c4b69997"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.057363 10935 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:06.059816 10951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.061194 10935 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:24:06.061338 10935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "1137104373844f578d8f35e9a5e737f4"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "dbfe6ccbbeaa307eea2afaa7de155008"
server_key_iv: "3ac17a36a85ccf665e7b6bb5c4b69997"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.061450 10935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:06.074273 10935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:06.074929 10935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:06.075124 10935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:06.075730 10935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:06.076697 10935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:06.076797 10935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.076881 10935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:06.076931 10935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.086412 10935 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:36331
I20260807 15:24:06.086447 11110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:36331 every 8 connection(s)
I20260807 15:24:06.087363 10935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:24:06.096226 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 10935
I20260807 15:24:06.096382 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:24:06.096825 16331 external_mini_cluster.cc:1428] Setting key f1d446e194801a54c000d08df43f7a22
I20260807 15:24:06.097950 10902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.089362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:50189 (local address 127.15.242.254:39707)
0807 15:24:06.089568 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.089572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.090740 (+ 1168us) server_negotiation.cc:407] Connection header received
0807 15:24:06.092214 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.092218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.092275 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.092379 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:06.093582 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.094171 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.095393 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.095608 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.095706 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.097110 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:06.097114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:06.097117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:06.097135 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:06.097159 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:06.097171 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:06.097301 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.097749 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.097810 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 15:24:06.098884 11114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.089833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39707 (local address 127.15.242.193:50189)
0807 15:24:06.090526 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.090567 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:06.091984 (+ 1417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:06.092563 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:06.092570 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:06.092709 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:06.093424 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.093438 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.094317 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.094320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.095269 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.095279 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.095826 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.095830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.095979 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.096739 (+ 760us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:06.096740 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:06.096829 (+ 89us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:06.096906 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:06.097352 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:06.097365 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:06.097373 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 15:24:06.097536 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 15:24:06.097857 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":115,"threads_started":1}
I20260807 15:24:06.098932 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39707
--builtin_ntp_servers=127.15.242.212:46801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 15:24:06.100260 11111 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39707
I20260807 15:24:06.100533 11111 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:06.101188 11111 heartbeater.cc:511] Master 127.15.242.254:39707 requested a full tablet report, sending...
I20260807 15:24:06.102811 10845 ts_manager.cc:194] Registered new tserver with Master: 1137104373844f578d8f35e9a5e737f4 (127.15.242.193:36331)
I20260807 15:24:06.104049 10845 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.193:50189
W20260807 15:24:06.217657 11115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:06.217968 11115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:06.218041 11115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:06.222074 11115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:06.222162 11115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:06.222257 11115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:24:06.227252 11115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:06.228375 11115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:06.229822 11115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:24:06.240183 11115 server_base.cc:1034] running on GCE node
W20260807 15:24:06.240127 11121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:06.240156 11124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:06.240110 11122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:06.240901 11115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:06.241698 11115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:06.242877 11115 hybrid_clock.cc:648] HybridClock initialized: now 1786116246242862 us; error 29 us; skew 500 ppm
I20260807 15:24:06.245258 11115 webserver.cc:460] Webserver started at http://127.15.242.194:40487/ using document root <none> and password file <none>
I20260807 15:24:06.245904 11115 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:06.245970 11115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:06.246201 11115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:06.248382 11115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "85b926c265e34535acac2528d8d340af"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "754f7d853b7c82dcffaed94688b3cdd4"
server_key_iv: "dc582b90fbb74fcc4bfe971806469199"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.249027 11115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "85b926c265e34535acac2528d8d340af"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "754f7d853b7c82dcffaed94688b3cdd4"
server_key_iv: "dc582b90fbb74fcc4bfe971806469199"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.253055 11115 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:24:06.255856 11133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.257427 11115 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:06.257597 11115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "85b926c265e34535acac2528d8d340af"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "754f7d853b7c82dcffaed94688b3cdd4"
server_key_iv: "dc582b90fbb74fcc4bfe971806469199"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.257793 11115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:06.278299 11115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:06.279115 11115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:06.279338 11115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:06.280031 11115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:06.281235 11115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:06.281309 11115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.281400 11115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:06.281450 11115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.291368 11115 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:33561
I20260807 15:24:06.291410 11325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:33561 every 8 connection(s)
I20260807 15:24:06.292460 11115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:24:06.297051 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 11115
I20260807 15:24:06.297222 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:24:06.297559 16331 external_mini_cluster.cc:1428] Setting key 5f6557af1156a8f6d584f36ca299e7fe
I20260807 15:24:06.299635 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39707
--builtin_ntp_servers=127.15.242.212:46801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 15:24:06.303572 10902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.294453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:47951 (local address 127.15.242.254:39707)
0807 15:24:06.294588 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.294592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.295782 (+ 1190us) server_negotiation.cc:407] Connection header received
0807 15:24:06.297642 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.297646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.297735 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.297821 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:06.298816 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.299350 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.300950 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.301322 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.301448 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.302960 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:06.302964 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:06.302966 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:06.302978 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:06.303000 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:06.303008 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:06.303065 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.303279 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.303360 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 15:24:06.304423 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.294869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39707 (local address 127.15.242.194:47951)
0807 15:24:06.295605 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.295648 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:06.297360 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:06.298045 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:06.298052 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:06.298139 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:06.298651 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.298663 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.299489 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.299493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.300815 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.300827 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.301616 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.301622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.301875 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.302619 (+ 744us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:06.302623 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:06.302684 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:06.302778 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:06.303091 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:06.303102 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:06.303112 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 15:24:06.303259 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 15:24:06.303538 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":141,"threads_started":1}
I20260807 15:24:06.305852 11326 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39707
I20260807 15:24:06.306103 11326 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:06.306670 11326 heartbeater.cc:511] Master 127.15.242.254:39707 requested a full tablet report, sending...
I20260807 15:24:06.307842 10845 ts_manager.cc:194] Registered new tserver with Master: 85b926c265e34535acac2528d8d340af (127.15.242.194:33561)
I20260807 15:24:06.308542 10845 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.194:47951
W20260807 15:24:06.419037 11329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:06.419299 11329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:06.419337 11329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:06.423355 11329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:06.423408 11329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:06.423461 11329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:24:06.428383 11329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:46801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:39707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:06.429510 11329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:06.430913 11329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:06.440971 11338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:06.441006 11341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:06.440990 11339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:06.441257 11329 server_base.cc:1034] running on GCE node
I20260807 15:24:06.441884 11329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:06.442682 11329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:06.443892 11329 hybrid_clock.cc:648] HybridClock initialized: now 1786116246443851 us; error 46 us; skew 500 ppm
I20260807 15:24:06.445946 11329 webserver.cc:460] Webserver started at http://127.15.242.195:36185/ using document root <none> and password file <none>
I20260807 15:24:06.446581 11329 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:06.446655 11329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:06.446839 11329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:06.449156 11329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "fb601d1beead45e08d04eb181dbf6ad3"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "7fbf68f33839b6f4375c8dba18e6cf2e"
server_key_iv: "80c87a998bb5badb5c8a9d721b692a56"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.449730 11329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "fb601d1beead45e08d04eb181dbf6ad3"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "7fbf68f33839b6f4375c8dba18e6cf2e"
server_key_iv: "80c87a998bb5badb5c8a9d721b692a56"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.453843 11329 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:24:06.456445 11351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.457962 11329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:24:06.458072 11329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "fb601d1beead45e08d04eb181dbf6ad3"
format_stamp: "Formatted at 2026-08-07 15:24:06 on dist-test-slave-g170"
server_key: "7fbf68f33839b6f4375c8dba18e6cf2e"
server_key_iv: "80c87a998bb5badb5c8a9d721b692a56"
server_key_version: "encryptionkey@0"
I20260807 15:24:06.458176 11329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:06.479943 11329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:06.480669 11329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:06.480916 11329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:06.481535 11329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:06.482517 11329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:06.482568 11329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.482609 11329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:06.482633 11329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:06.494642 11329 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:42195
I20260807 15:24:06.494755 11530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:42195 every 8 connection(s)
I20260807 15:24:06.495750 11329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:24:06.498348 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 11329
I20260807 15:24:06.498478 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:24:06.498838 16331 external_mini_cluster.cc:1428] Setting key 559542d912139cde1d76a79032cce504
I20260807 15:24:06.506649 10902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.498012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:52467 (local address 127.15.242.254:39707)
0807 15:24:06.498183 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.498188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.499582 (+ 1394us) server_negotiation.cc:407] Connection header received
0807 15:24:06.501437 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.501440 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.501487 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.501555 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:06.502525 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.503160 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.504597 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.504921 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.505016 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.506202 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:06.506205 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:06.506207 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:06.506220 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:06.506245 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:06.506254 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:06.506324 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.506470 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.506532 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 15:24:06.507616 11534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.498532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:39707 (local address 127.15.242.195:52467)
0807 15:24:06.499405 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.499464 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:06.501216 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:06.501731 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:06.501738 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:06.501824 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:06.502363 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.502376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.503293 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.503296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.504474 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.504486 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.505088 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.505091 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.505275 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.505938 (+ 663us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:06.505940 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:06.505983 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:06.506052 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:06.506340 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:06.506348 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:06.506353 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 15:24:06.506457 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 15:24:06.506692 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":123,"threads_started":1}
I20260807 15:24:06.508945 11532 heartbeater.cc:347] Connected to a master server at 127.15.242.254:39707
I20260807 15:24:06.509227 11532 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:06.509841 11532 heartbeater.cc:511] Master 127.15.242.254:39707 requested a full tablet report, sending...
I20260807 15:24:06.511001 10845 ts_manager.cc:194] Registered new tserver with Master: fb601d1beead45e08d04eb181dbf6ad3 (127.15.242.195:42195)
I20260807 15:24:06.511677 10845 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.195:52467
I20260807 15:24:06.513170 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:24:06.519193 10902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.515187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56230 (local address 127.15.242.254:39707)
0807 15:24:06.515328 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.515332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.515505 (+ 173us) server_negotiation.cc:407] Connection header received
0807 15:24:06.515576 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.515579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.515632 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.515725 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:06.515964 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.516512 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.517622 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.517875 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.517970 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.518791 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:06.518794 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:06.518797 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:06.518809 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:06.518829 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:06.518837 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:06.518897 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.519001 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.519056 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:24:06.522324 10845 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:24:06.525566 10845 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:24:06.542429 11548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.535712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57654 (local address 127.15.242.195:42195)
0807 15:24:06.536265 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.536279 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.536862 (+ 583us) server_negotiation.cc:407] Connection header received
0807 15:24:06.537050 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.537057 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.537317 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.537520 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:06.538074 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.539220 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.541135 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.541683 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.541830 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.542030 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.542132 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.542236 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":193,"threads_started":1}
I20260807 15:24:06.542439 11550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.535381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42195 (local address 127.0.0.1:57654)
0807 15:24:06.536592 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.536608 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:06.536716 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:06.537698 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:06.537701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:06.537737 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:06.537935 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.537944 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.539351 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.539354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.540973 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.540985 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.541820 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.541824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.541936 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.541973 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 15:24:06.542103 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 15:24:06.542243 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1140,"mutex_wait_us":234,"spinlock_wait_cycles":8832,"thread_start_us":112,"threads_started":1}
I20260807 15:24:06.542821 11546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.535337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:33561 (local address 127.0.0.1:50136)
0807 15:24:06.536079 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.536145 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:06.536303 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:06.537530 (+ 1227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:06.537536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:06.537559 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:06.537726 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.537733 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.539261 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.539268 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.540973 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.540985 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.542140 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.542147 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.542446 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.542476 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 15:24:06.542553 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 15:24:06.542638 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"mutex_wait_us":360,"thread_start_us":86,"threads_started":1}
I20260807 15:24:06.542982 11544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.536154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36331 (local address 127.0.0.1:33256)
0807 15:24:06.536726 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.536741 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:06.536879 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:06.537698 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:06.537701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:06.537736 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:06.537940 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.537946 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.539146 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.539150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.540644 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.540655 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.542182 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.542185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.542465 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.542674 (+ 209us) client_negotiation.cc:769] Sending connection context
0807 15:24:06.542748 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 15:24:06.542831 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":266,"spinlock_wait_cycles":6784,"thread_start_us":116,"threads_started":1}
I20260807 15:24:06.543572 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.536228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50136 (local address 127.15.242.194:33561)
0807 15:24:06.537094 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.537112 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.537132 (+ 20us) server_negotiation.cc:407] Connection header received
0807 15:24:06.537198 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.537202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.537358 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.537524 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:06.537851 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.539110 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.541125 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.541980 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.542985 (+ 1005us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.543198 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.543249 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.543358 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":149,"threads_started":1}
I20260807 15:24:06.543571 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.536589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33256 (local address 127.15.242.193:36331)
0807 15:24:06.537105 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.537118 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.537140 (+ 22us) server_negotiation.cc:407] Connection header received
0807 15:24:06.537213 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.537217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.537395 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.537537 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:06.538112 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.538963 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.540850 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.541753 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.541915 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.542125 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.543153 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.543349 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":120,"threads_started":1}
I20260807 15:24:06.546505 11432 tablet_service.cc:1467] Processing CreateTablet for tablet ffa8307ebcdd46efb62ca09c7354e0a6 (DEFAULT_TABLE table=test-table [id=e88b5df5d7b849d6a96e610b88599c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:06.546543 11016 tablet_service.cc:1467] Processing CreateTablet for tablet ffa8307ebcdd46efb62ca09c7354e0a6 (DEFAULT_TABLE table=test-table [id=e88b5df5d7b849d6a96e610b88599c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:06.547873 11432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa8307ebcdd46efb62ca09c7354e0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:06.547873 11016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa8307ebcdd46efb62ca09c7354e0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:06.554759 11554 tablet_bootstrap.cc:492] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: Bootstrap starting.
I20260807 15:24:06.554389 11213 tablet_service.cc:1467] Processing CreateTablet for tablet ffa8307ebcdd46efb62ca09c7354e0a6 (DEFAULT_TABLE table=test-table [id=e88b5df5d7b849d6a96e610b88599c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:06.555612 11213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa8307ebcdd46efb62ca09c7354e0a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:06.557260 11556 tablet_bootstrap.cc:492] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4: Bootstrap starting.
I20260807 15:24:06.557399 11554 tablet_bootstrap.cc:654] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:06.558470 11554 log.cc:824] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:06.559783 11556 tablet_bootstrap.cc:654] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:06.560560 11556 log.cc:824] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:06.560885 11554 tablet_bootstrap.cc:492] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: No bootstrap required, opened a new log
I20260807 15:24:06.561100 11554 ts_tablet_manager.cc:1397] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:24:06.563179 11556 tablet_bootstrap.cc:492] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4: No bootstrap required, opened a new log
I20260807 15:24:06.563490 11556 ts_tablet_manager.cc:1397] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260807 15:24:06.563520 11560 tablet_bootstrap.cc:492] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: Bootstrap starting.
I20260807 15:24:06.565877 11554 raft_consensus.cc:348] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.566134 11554 raft_consensus.cc:374] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:06.566179 11560 tablet_bootstrap.cc:654] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:06.566224 11554 raft_consensus.cc:729] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb601d1beead45e08d04eb181dbf6ad3, State: Initialized, Role: FOLLOWER
I20260807 15:24:06.566794 11554 consensus_queue.cc:260] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.567217 11560 log.cc:824] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:06.567478 11532 heartbeater.cc:503] Master 127.15.242.254:39707 was elected leader, sending a full tablet report...
I20260807 15:24:06.567859 11554 ts_tablet_manager.cc:1428] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:24:06.568499 11556 raft_consensus.cc:348] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.568840 11556 raft_consensus.cc:374] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:06.568913 11556 raft_consensus.cc:729] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1137104373844f578d8f35e9a5e737f4, State: Initialized, Role: FOLLOWER
I20260807 15:24:06.569396 11556 consensus_queue.cc:260] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.569977 11560 tablet_bootstrap.cc:492] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: No bootstrap required, opened a new log
I20260807 15:24:06.570159 11111 heartbeater.cc:503] Master 127.15.242.254:39707 was elected leader, sending a full tablet report...
I20260807 15:24:06.570227 11560 ts_tablet_manager.cc:1397] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:24:06.570538 11556 ts_tablet_manager.cc:1428] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 15:24:06.575023 11560 raft_consensus.cc:348] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.575253 11560 raft_consensus.cc:374] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:06.575289 11560 raft_consensus.cc:729] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b926c265e34535acac2528d8d340af, State: Initialized, Role: FOLLOWER
I20260807 15:24:06.575663 11560 consensus_queue.cc:260] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.576308 11326 heartbeater.cc:503] Master 127.15.242.254:39707 was elected leader, sending a full tablet report...
I20260807 15:24:06.576675 11560 ts_tablet_manager.cc:1428] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260807 15:24:06.588670 11112 tablet.cc:2369] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:24:06.611106 11564 raft_consensus.cc:482] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:24:06.611392 11564 raft_consensus.cc:504] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.612915 11564 leader_election.cc:288] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb601d1beead45e08d04eb181dbf6ad3 (127.15.242.195:42195), 1137104373844f578d8f35e9a5e737f4 (127.15.242.193:36331)
I20260807 15:24:06.617347 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.613835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:32773 (local address 127.15.242.193:36331)
0807 15:24:06.614028 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.614034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.614082 (+ 48us) server_negotiation.cc:407] Connection header received
0807 15:24:06.614142 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.614145 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.614203 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.614395 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:06.614730 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.615212 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.616327 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.616739 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.616907 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.616962 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.617139 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.617217 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 15:24:06.617372 11565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.613201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36331 (local address 127.15.242.194:32773)
0807 15:24:06.613868 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.613886 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:06.613989 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:06.614402 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:06.614404 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:06.614422 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:06.614584 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.614594 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.615325 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.615330 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.616196 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.616207 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.616899 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.616903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.617003 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.617031 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 15:24:06.617120 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 15:24:06.617202 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":21,"thread_start_us":160,"threads_started":1}
I20260807 15:24:06.617517 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.613094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:42195 (local address 127.15.242.194:33913)
0807 15:24:06.613249 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.613268 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:06.613382 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:06.614052 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:06.614055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:06.614074 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:06.614174 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.614180 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.615276 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.615282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.616226 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:06.616237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.617047 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.617051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:06.617173 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.617193 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 15:24:06.617297 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 15:24:06.617380 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":43}
I20260807 15:24:06.617527 11548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.613385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:33913 (local address 127.15.242.195:42195)
0807 15:24:06.613560 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.613565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.613582 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:24:06.613667 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.613673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.613779 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.613871 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:06.614376 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.615134 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.616383 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.616893 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.617038 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.617100 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.617331 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.617410 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:24:06.618337 11043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa8307ebcdd46efb62ca09c7354e0a6" candidate_uuid: "85b926c265e34535acac2528d8d340af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1137104373844f578d8f35e9a5e737f4" is_pre_election: true
I20260807 15:24:06.618337 11460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa8307ebcdd46efb62ca09c7354e0a6" candidate_uuid: "85b926c265e34535acac2528d8d340af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb601d1beead45e08d04eb181dbf6ad3" is_pre_election: true
I20260807 15:24:06.618703 11043 raft_consensus.cc:2454] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b926c265e34535acac2528d8d340af in term 0.
I20260807 15:24:06.618703 11460 raft_consensus.cc:2454] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b926c265e34535acac2528d8d340af in term 0.
I20260807 15:24:06.619335 11138 leader_election.cc:302] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1137104373844f578d8f35e9a5e737f4, 85b926c265e34535acac2528d8d340af, fb601d1beead45e08d04eb181dbf6ad3; no voters:
I20260807 15:24:06.619789 11564 raft_consensus.cc:2781] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:24:06.619903 11564 raft_consensus.cc:482] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:24:06.619953 11564 raft_consensus.cc:3037] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:06.621234 11564 raft_consensus.cc:504] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.621675 11564 leader_election.cc:288] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [CANDIDATE]: Term 1 election: Requested vote from peers fb601d1beead45e08d04eb181dbf6ad3 (127.15.242.195:42195), 1137104373844f578d8f35e9a5e737f4 (127.15.242.193:36331)
I20260807 15:24:06.622081 11460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa8307ebcdd46efb62ca09c7354e0a6" candidate_uuid: "85b926c265e34535acac2528d8d340af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb601d1beead45e08d04eb181dbf6ad3"
I20260807 15:24:06.622126 11043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa8307ebcdd46efb62ca09c7354e0a6" candidate_uuid: "85b926c265e34535acac2528d8d340af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1137104373844f578d8f35e9a5e737f4"
I20260807 15:24:06.622234 11460 raft_consensus.cc:3037] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:06.622287 11043 raft_consensus.cc:3037] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:06.623389 11460 raft_consensus.cc:2454] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b926c265e34535acac2528d8d340af in term 1.
I20260807 15:24:06.623399 11043 raft_consensus.cc:2454] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b926c265e34535acac2528d8d340af in term 1.
I20260807 15:24:06.623764 11138 leader_election.cc:302] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b926c265e34535acac2528d8d340af, fb601d1beead45e08d04eb181dbf6ad3; no voters:
I20260807 15:24:06.623957 11564 raft_consensus.cc:2781] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:06.624289 11564 raft_consensus.cc:686] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 1 LEADER]: Becoming Leader. State: Replica: 85b926c265e34535acac2528d8d340af, State: Running, Role: LEADER
I20260807 15:24:06.624665 11564 consensus_queue.cc:237] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } }
I20260807 15:24:06.628710 10844 catalog_manager.cc:5495] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af reported cstate change: term changed from 0 to 1, leader changed from <none> to 85b926c265e34535acac2528d8d340af (127.15.242.194). New cstate: current_term: 1 leader_uuid: "85b926c265e34535acac2528d8d340af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b926c265e34535acac2528d8d340af" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 33561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 } health_report { overall_health: UNKNOWN } } }
I20260807 15:24:06.642590 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.638744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50146 (local address 127.15.242.194:33561)
0807 15:24:06.638898 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:06.638905 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:06.638921 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:24:06.639111 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:06.639113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:06.639171 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:06.639288 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:06.639532 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.640038 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.640966 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:06.641187 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:06.641289 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:06.641615 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:06.642058 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:06.642247 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:06.642313 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 15:24:06.642371 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 15:24:06.648900 11460 raft_consensus.cc:1261] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 1 FOLLOWER]: Refusing update from remote peer 85b926c265e34535acac2528d8d340af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:06.648955 11043 raft_consensus.cc:1261] T ffa8307ebcdd46efb62ca09c7354e0a6 P 1137104373844f578d8f35e9a5e737f4 [term 1 FOLLOWER]: Refusing update from remote peer 85b926c265e34535acac2528d8d340af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:06.649660 11566 consensus_queue.cc:1035] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb601d1beead45e08d04eb181dbf6ad3" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 42195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:06.649849 11564 consensus_queue.cc:1035] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [LEADER]: Connected to new peer: Peer: permanent_uuid: "1137104373844f578d8f35e9a5e737f4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:06.657858 11570 mvcc.cc:205] Tried to move back new op lower bound from 7315932146266210304 to 7315932146178646016. Current Snapshot: MvccSnapshot[applied={T|T < 7315932146266210304}]
I20260807 15:24:06.660276 11573 mvcc.cc:205] Tried to move back new op lower bound from 7315932146266210304 to 7315932146178646016. Current Snapshot: MvccSnapshot[applied={T|T < 7315932146266210304}]
I20260807 15:24:06.661201 11572 mvcc.cc:205] Tried to move back new op lower bound from 7315932146266210304 to 7315932146178646016. Current Snapshot: MvccSnapshot[applied={T|T < 7315932146266210304}]
I20260807 15:24:06.667557 10844 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:06.667771 10844 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:06.670647 10844 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3cdf30045bbc4f51a926c640b42baad2: Sending DeleteTablet for 3 replicas of tablet ffa8307ebcdd46efb62ca09c7354e0a6
I20260807 15:24:06.671551 11213 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa8307ebcdd46efb62ca09c7354e0a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:06 UTC) from {username='slave'} at 127.0.0.1:50136
I20260807 15:24:06.671557 11432 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa8307ebcdd46efb62ca09c7354e0a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:06 UTC) from {username='slave'} at 127.0.0.1:57654
I20260807 15:24:06.671600 11016 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa8307ebcdd46efb62ca09c7354e0a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:06 UTC) from {username='slave'} at 127.0.0.1:33256
I20260807 15:24:06.672205 11583 tablet_replica.cc:330] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: stopping tablet replica
I20260807 15:24:06.672314 11584 tablet_replica.cc:330] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: stopping tablet replica
I20260807 15:24:06.672552 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 10935
I20260807 15:24:06.682298 11584 raft_consensus.cc:2229] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:24:06.682809 11584 raft_consensus.cc:2258] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:06.686872 11584 ts_tablet_manager.cc:1905] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:06.672639 11583 raft_consensus.cc:2229] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:24:06.687837 11583 raft_consensus.cc:2258] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:06.689668 11583 ts_tablet_manager.cc:1905] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:06.690692 11584 ts_tablet_manager.cc:1918] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:06.690868 11584 log.cc:1196] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/ffa8307ebcdd46efb62ca09c7354e0a6
I20260807 15:24:06.691288 11584 ts_tablet_manager.cc:1939] T ffa8307ebcdd46efb62ca09c7354e0a6 P fb601d1beead45e08d04eb181dbf6ad3: Deleting consensus metadata
I20260807 15:24:06.692517 11583 ts_tablet_manager.cc:1918] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:06.692688 11583 log.cc:1196] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/ffa8307ebcdd46efb62ca09c7354e0a6
I20260807 15:24:06.692924 10821 catalog_manager.cc:4841] TS fb601d1beead45e08d04eb181dbf6ad3 (127.15.242.195:42195): tablet ffa8307ebcdd46efb62ca09c7354e0a6 (table test-table [id=e88b5df5d7b849d6a96e610b88599c23]) successfully deleted
I20260807 15:24:06.693094 11583 ts_tablet_manager.cc:1939] T ffa8307ebcdd46efb62ca09c7354e0a6 P 85b926c265e34535acac2528d8d340af: Deleting consensus metadata
I20260807 15:24:06.694270 10823 catalog_manager.cc:4841] TS 85b926c265e34535acac2528d8d340af (127.15.242.194:33561): tablet ffa8307ebcdd46efb62ca09c7354e0a6 (table test-table [id=e88b5df5d7b849d6a96e610b88599c23]) successfully deleted
W20260807 15:24:06.695300 10822 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:36331 (error 108)
I20260807 15:24:06.695487 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 11115
I20260807 15:24:06.701236 11544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:06.700907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36331 (local address 127.0.0.1:33268)
0807 15:24:06.701062 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:06.701146 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:36331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 15:24:06.701418 10822 catalog_manager.cc:4584] TS 1137104373844f578d8f35e9a5e737f4 (127.15.242.193:36331): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ffa8307ebcdd46efb62ca09c7354e0a6: Network error: Client connection negotiation failed: client connection to 127.15.242.193:36331: connect: Connection refused (error 111)
I20260807 15:24:06.707623 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 11329
I20260807 15:24:06.726204 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 10798
2026-08-07T15:24:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1127 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:06 dist-test-slave-g170 krb5kdc[11590](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:06 dist-test-slave-g170 krb5kdc[11590](info): set up 2 sockets
Aug 07 15:24:06 dist-test-slave-g170 krb5kdc[11590](info): commencing operation
krb5kdc: starting...
W20260807 15:24:08.033560 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:08 dist-test-slave-g170 krb5kdc[11590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:08.176950 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:35341
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:35341
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:08.307847 11609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:08.308214 11609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:08.308308 11609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:08.312500 11609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:08.312615 11609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:08.312649 11609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:08.312687 11609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:08.312716 11609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:08.318470 11609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:35341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:35341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:08.319717 11609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:08.320883 11609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:08.330076 11617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:08.330296 11609 server_base.cc:1034] running on GCE node
W20260807 15:24:08.330065 11620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:08.330061 11618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:08.331050 11609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:08.332199 11609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:08.333392 11609 hybrid_clock.cc:648] HybridClock initialized: now 1786116248333375 us; error 31 us; skew 500 ppm
Aug 07 15:24:08 dist-test-slave-g170 krb5kdc[11590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116248, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:08.339689 11609 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:08.340715 11609 webserver.cc:460] Webserver started at http://127.15.242.254:46085/ using document root <none> and password file <none>
I20260807 15:24:08.341355 11609 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:08.341423 11609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:08.341602 11609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:08.343722 11609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "458f301dac324853b8e5336a6f767066"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "7f80e90f69f0e58ccd0f9d80053fd140"
server_key_iv: "d5216b68d4c3403c5725c89f400694cd"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.344273 11609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "458f301dac324853b8e5336a6f767066"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "7f80e90f69f0e58ccd0f9d80053fd140"
server_key_iv: "d5216b68d4c3403c5725c89f400694cd"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.348444 11609 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260807 15:24:08.351413 11634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:08.352916 11609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:08.353052 11609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "458f301dac324853b8e5336a6f767066"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "7f80e90f69f0e58ccd0f9d80053fd140"
server_key_iv: "d5216b68d4c3403c5725c89f400694cd"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.353168 11609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:08.365188 11609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:08.368585 11609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:08.368889 11609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:08.376206 11609 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:35341
I20260807 15:24:08.376241 11720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:35341 every 8 connection(s)
I20260807 15:24:08.377219 11609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:08.380328 11721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:08.385494 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 11609
I20260807 15:24:08.385661 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:08.385943 16331 external_mini_cluster.cc:1428] Setting key 55aac32543dacfa6e725b7aa2f15fb6a
I20260807 15:24:08.386812 11721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066: Bootstrap starting.
I20260807 15:24:08.389662 11721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:08.390506 11721 log.cc:824] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:08.392583 11721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066: No bootstrap required, opened a new log
Aug 07 15:24:08 dist-test-slave-g170 krb5kdc[11590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:08.396654 11721 raft_consensus.cc:348] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "458f301dac324853b8e5336a6f767066" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35341 } }
I20260807 15:24:08.396970 11721 raft_consensus.cc:374] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:08.397060 11721 raft_consensus.cc:729] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 458f301dac324853b8e5336a6f767066, State: Initialized, Role: FOLLOWER
I20260807 15:24:08.397661 11721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "458f301dac324853b8e5336a6f767066" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35341 } }
I20260807 15:24:08.397871 11721 raft_consensus.cc:388] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:08.397964 11721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:08.398067 11721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:08.399010 11721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "458f301dac324853b8e5336a6f767066" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35341 } }
I20260807 15:24:08.399360 11721 leader_election.cc:302] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 458f301dac324853b8e5336a6f767066; no voters:
I20260807 15:24:08.399696 11721 leader_election.cc:288] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:08.399782 11730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:08.400012 11730 raft_consensus.cc:686] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [term 1 LEADER]: Becoming Leader. State: Replica: 458f301dac324853b8e5336a6f767066, State: Running, Role: LEADER
I20260807 15:24:08.400413 11730 consensus_queue.cc:237] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "458f301dac324853b8e5336a6f767066" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35341 } }
I20260807 15:24:08.401149 11721 sys_catalog.cc:564] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:08.401765 11730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "458f301dac324853b8e5336a6f767066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "458f301dac324853b8e5336a6f767066" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35341 } } }
I20260807 15:24:08.401930 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:08.387536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44864 (local address 127.15.242.254:35341)
0807 15:24:08.388049 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:08.388067 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:08.388128 (+ 61us) server_negotiation.cc:407] Connection header received
0807 15:24:08.388888 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:08.388909 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:08.389262 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:08.389618 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:08.390581 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.391647 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.392556 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.393140 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.393325 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:08.395992 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:08.395997 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:08.396011 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:08.396041 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:08.398421 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:08.398882 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:08.398888 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:08.398895 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:08.399016 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:08.399330 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:08.399334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:08.399335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:08.399910 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:08.400141 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:08.400455 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 15:24:08.400956 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":160,"threads_started":1}
I20260807 15:24:08.401978 11730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:08.402231 11732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 458f301dac324853b8e5336a6f767066. Latest consensus state: current_term: 1 leader_uuid: "458f301dac324853b8e5336a6f767066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "458f301dac324853b8e5336a6f767066" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35341 } } }
I20260807 15:24:08.402387 11732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:08.402804 11742 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:08.406839 11742 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:08.413471 11742 catalog_manager.cc:1347] Generated new cluster ID: dc31a7dccb974bdd9b06d11328180b4d
I20260807 15:24:08.413558 11742 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:08.430768 11742 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:08.432121 11742 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:08.448206 11742 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066: Generated new TSK 0
I20260807 15:24:08.449193 11742 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:24:08.492730 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:35341
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:08.615733 11759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:08.616055 11759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:08.616132 11759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:08.620503 11759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:08.620596 11759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:08.620678 11759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:24:08.626842 11759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:35341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:08.627894 11759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:08.628968 11759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 15:24:08.639040 11759 server_base.cc:1034] running on GCE node
W20260807 15:24:08.639050 11770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:08.639225 11771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:08.639065 11775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:08.639758 11759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:08.640509 11759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:08.641712 11759 hybrid_clock.cc:648] HybridClock initialized: now 1786116248641673 us; error 44 us; skew 500 ppm
Aug 07 15:24:08 dist-test-slave-g170 krb5kdc[11590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116248, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:08.644721 11759 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:24:08.645675 11759 webserver.cc:460] Webserver started at http://127.15.242.193:34975/ using document root <none> and password file <none>
I20260807 15:24:08.646270 11759 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:08.646339 11759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:08.646554 11759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:08.648639 11759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "ac5e508be9ee4cacb89cacd762c9adc4"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "f3d4794a949bed89a4173be542b68cab"
server_key_iv: "8b0fd4c440726b5051043fd4b785fa52"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.649281 11759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "ac5e508be9ee4cacb89cacd762c9adc4"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "f3d4794a949bed89a4173be542b68cab"
server_key_iv: "8b0fd4c440726b5051043fd4b785fa52"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.653363 11759 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:24:08.656136 11787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:08.657689 11759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:08.657843 11759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "ac5e508be9ee4cacb89cacd762c9adc4"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "f3d4794a949bed89a4173be542b68cab"
server_key_iv: "8b0fd4c440726b5051043fd4b785fa52"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.657979 11759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:08.673017 11759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:08.676656 11759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:08.676906 11759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:08.677591 11759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:08.678563 11759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:08.678639 11759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:08.678714 11759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:08.678768 11759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:08.689000 11759 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:36517
I20260807 15:24:08.689052 11940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:36517 every 8 connection(s)
I20260807 15:24:08.690034 11759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:24:08.691442 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 11759
I20260807 15:24:08.691609 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:24:08.691978 16331 external_mini_cluster.cc:1428] Setting key d9fe5360beb1c7a38e3d11cf689ca681
Aug 07 15:24:08 dist-test-slave-g170 krb5kdc[11590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116248, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
I20260807 15:24:08.706995 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:08.692139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:41371 (local address 127.15.242.254:35341)
0807 15:24:08.692333 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:08.692338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:08.693455 (+ 1117us) server_negotiation.cc:407] Connection header received
0807 15:24:08.695123 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:08.695134 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:08.695215 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:08.695318 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:08.697190 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.697772 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.699184 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.699464 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.699581 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:08.702734 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:08.702739 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:08.702742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:08.702783 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:08.704523 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:08.705195 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:08.705199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:08.705201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:08.705307 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:08.705706 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:08.705710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:08.705712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:08.705934 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:08.706045 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:08.706658 (+ 613us) server_negotiation.cc:299] Negotiation successful
0807 15:24:08.706807 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 15:24:08.707974 11946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:08.692570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:35341 (local address 127.15.242.193:41371)
0807 15:24:08.693260 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:08.693325 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:08.694861 (+ 1536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:08.695514 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:08.695521 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:08.696109 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:08.696997 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:08.697025 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.697912 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.697915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:08.699028 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:08.699039 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.699653 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.699658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:08.699870 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:08.700561 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:08.700581 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:08.702537 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:08.704666 (+ 2129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:08.704674 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:08.704695 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:08.705073 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:08.705410 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:08.705414 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:08.705416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:08.705592 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:08.706063 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:08.706073 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:08.706369 (+ 296us) client_negotiation.cc:769] Sending connection context
0807 15:24:08.706594 (+ 225us) client_negotiation.cc:240] Negotiation successful
0807 15:24:08.707001 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":191,"threads_started":1}
I20260807 15:24:08.709501 11943 heartbeater.cc:347] Connected to a master server at 127.15.242.254:35341
I20260807 15:24:08.709782 11943 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:08.710327 11943 heartbeater.cc:511] Master 127.15.242.254:35341 requested a full tablet report, sending...
I20260807 15:24:08.712168 11665 ts_manager.cc:194] Registered new tserver with Master: ac5e508be9ee4cacb89cacd762c9adc4 (127.15.242.193:36517)
I20260807 15:24:08.714061 11665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:41371
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:24:08.727897 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:35341
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:08.855882 11950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:08.856175 11950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:08.856223 11950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:08.860731 11950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:08.860841 11950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:08.860942 11950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:24:08.866938 11950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:35341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:08.868153 11950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:08.869345 11950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:08.880321 11957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:08.880403 11950 server_base.cc:1034] running on GCE node
W20260807 15:24:08.880316 11958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:08.880316 11961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:08.881143 11950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:08.881855 11950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:08.883023 11950 hybrid_clock.cc:648] HybridClock initialized: now 1786116248883023 us; error 54 us; skew 500 ppm
Aug 07 15:24:08 dist-test-slave-g170 krb5kdc[11590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116248, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:08.886081 11950 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:24:08.887024 11950 webserver.cc:460] Webserver started at http://127.15.242.194:33009/ using document root <none> and password file <none>
I20260807 15:24:08.887615 11950 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:08.887679 11950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:08.887897 11950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:08.890190 11950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "f63ff5636e27428aaeab35ae3fb88567"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "5949a88900c8e168c0f1dbcd85282ea7"
server_key_iv: "5f23d43d65aadca69f559c26093ece56"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.890810 11950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "f63ff5636e27428aaeab35ae3fb88567"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "5949a88900c8e168c0f1dbcd85282ea7"
server_key_iv: "5f23d43d65aadca69f559c26093ece56"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.894927 11950 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:08.897743 11971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:08.899212 11950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:08.899355 11950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "f63ff5636e27428aaeab35ae3fb88567"
format_stamp: "Formatted at 2026-08-07 15:24:08 on dist-test-slave-g170"
server_key: "5949a88900c8e168c0f1dbcd85282ea7"
server_key_iv: "5f23d43d65aadca69f559c26093ece56"
server_key_version: "encryptionkey@0"
I20260807 15:24:08.899478 11950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:08.913383 11950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:08.916965 11950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:08.917172 11950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:08.917822 11950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:08.918718 11950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:08.918766 11950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:08.918833 11950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:08.918871 11950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:08.928076 11950 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:42017
I20260807 15:24:08.928102 12165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:42017 every 8 connection(s)
I20260807 15:24:08.929061 11950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:24:08.936532 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 11950
I20260807 15:24:08.936674 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:24:08.937060 16331 external_mini_cluster.cc:1428] Setting key 736382a32ae2cb42eadbf1e7af02048d
Aug 07 15:24:08 dist-test-slave-g170 krb5kdc[11590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116248, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:08.944540 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:08.930978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:60027 (local address 127.15.242.254:35341)
0807 15:24:08.931150 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:08.931156 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:08.932035 (+ 879us) server_negotiation.cc:407] Connection header received
0807 15:24:08.933444 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:08.933448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:08.933511 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:08.933605 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:08.934816 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.935336 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.936587 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.936971 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.937091 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:08.940002 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:08.940009 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:08.940015 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:08.940052 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:08.941872 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:08.942615 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:08.942618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:08.942620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:08.942704 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:08.943128 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:08.943134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:08.943139 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:08.943424 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:08.943533 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:08.944080 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 15:24:08.944278 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 15:24:08.945309 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:08.931383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:35341 (local address 127.15.242.194:60027)
0807 15:24:08.931885 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:08.931928 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:08.933203 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:08.933795 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:08.933802 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:08.934164 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:08.934669 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:08.934682 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.935475 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.935478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:08.936450 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:08.936461 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:08.937148 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:08.937155 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:08.937336 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:08.937990 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:08.938007 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:08.939817 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:08.942003 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:08.942012 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:08.942032 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:08.942508 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:08.942853 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:08.942855 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:08.942856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:08.943030 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:08.943538 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:08.943543 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:08.943824 (+ 281us) client_negotiation.cc:769] Sending connection context
0807 15:24:08.943993 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 15:24:08.944305 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":110,"threads_started":1}
I20260807 15:24:08.946588 12166 heartbeater.cc:347] Connected to a master server at 127.15.242.254:35341
I20260807 15:24:08.946874 12166 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:08.947562 12166 heartbeater.cc:511] Master 127.15.242.254:35341 requested a full tablet report, sending...
I20260807 15:24:08.948908 11665 ts_manager.cc:194] Registered new tserver with Master: f63ff5636e27428aaeab35ae3fb88567 (127.15.242.194:42017)
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:24:08.949707 11665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:60027
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:24:08.972842 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:35341
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:09.096333 12173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:09.096645 12173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:09.096727 12173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:09.100894 12173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:09.100975 12173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:09.101063 12173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:24:09.106698 12173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:35341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:09.107820 12173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:09.108995 12173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:09.119732 12185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:09.119751 12184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:09.119771 12191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:09.120091 12173 server_base.cc:1034] running on GCE node
I20260807 15:24:09.120741 12173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:09.121536 12173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:09.122738 12173 hybrid_clock.cc:648] HybridClock initialized: now 1786116249122701 us; error 53 us; skew 500 ppm
Aug 07 15:24:09 dist-test-slave-g170 krb5kdc[11590](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116249, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:09.125684 12173 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:24:09.126713 12173 webserver.cc:460] Webserver started at http://127.15.242.195:42989/ using document root <none> and password file <none>
I20260807 15:24:09.127332 12173 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:09.127425 12173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:09.127666 12173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:09.129838 12173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "af7d66bde949462b9dade1e710d7ba5b"
format_stamp: "Formatted at 2026-08-07 15:24:09 on dist-test-slave-g170"
server_key: "fba3bd2ecdb3e4d918609d269b09489f"
server_key_iv: "b6728afc566304e4609267c253df5126"
server_key_version: "encryptionkey@0"
I20260807 15:24:09.130409 12173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "af7d66bde949462b9dade1e710d7ba5b"
format_stamp: "Formatted at 2026-08-07 15:24:09 on dist-test-slave-g170"
server_key: "fba3bd2ecdb3e4d918609d269b09489f"
server_key_iv: "b6728afc566304e4609267c253df5126"
server_key_version: "encryptionkey@0"
I20260807 15:24:09.134270 12173 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:24:09.136976 12201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:09.138520 12173 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:09.138705 12173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "af7d66bde949462b9dade1e710d7ba5b"
format_stamp: "Formatted at 2026-08-07 15:24:09 on dist-test-slave-g170"
server_key: "fba3bd2ecdb3e4d918609d269b09489f"
server_key_iv: "b6728afc566304e4609267c253df5126"
server_key_version: "encryptionkey@0"
I20260807 15:24:09.138839 12173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:09.153314 12173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:09.156983 12173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:09.157194 12173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:09.157935 12173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:09.158865 12173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:09.158933 12173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:09.159004 12173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:09.159044 12173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:09.169023 12173 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:43213
I20260807 15:24:09.169178 12371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:43213 every 8 connection(s)
I20260807 15:24:09.170025 12173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:24:09.171308 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 12173
I20260807 15:24:09.171466 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:24:09.171991 16331 external_mini_cluster.cc:1428] Setting key d1899704e799cef3324ab70cb12362b5
Aug 07 15:24:09 dist-test-slave-g170 krb5kdc[11590](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116249, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:09.185201 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.172321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:57929 (local address 127.15.242.254:35341)
0807 15:24:09.172492 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:09.172495 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:09.173596 (+ 1101us) server_negotiation.cc:407] Connection header received
0807 15:24:09.175264 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:09.175267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:09.175313 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:09.175383 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:09.176661 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.177271 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.178649 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.178865 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.178948 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.181702 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:09.181705 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:09.181707 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:09.181736 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:09.183141 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:09.183633 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:09.183635 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:09.183636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:09.183712 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:09.184025 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:09.184027 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:09.184028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:09.184204 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:09.184300 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:09.184878 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 15:24:09.185013 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 15:24:09.186312 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.172752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:35341 (local address 127.15.242.195:57929)
0807 15:24:09.173393 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:09.173462 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:09.175026 (+ 1564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:09.175544 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:09.175551 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:09.175967 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:09.176515 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.176530 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.177419 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.177422 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.178516 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.178528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.179010 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.179013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.179179 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.179867 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:09.179886 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:09.181536 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:09.183256 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:09.183261 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:09.183274 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:09.183541 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:09.183804 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:09.183806 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:09.183807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:09.183946 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:09.184321 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:09.184326 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:09.184569 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 15:24:09.184822 (+ 253us) client_negotiation.cc:240] Negotiation successful
0807 15:24:09.185191 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":137,"threads_started":1}
I20260807 15:24:09.187593 12372 heartbeater.cc:347] Connected to a master server at 127.15.242.254:35341
I20260807 15:24:09.187862 12372 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:09.188413 12372 heartbeater.cc:511] Master 127.15.242.254:35341 requested a full tablet report, sending...
I20260807 15:24:09.189487 11665 ts_manager.cc:194] Registered new tserver with Master: af7d66bde949462b9dade1e710d7ba5b (127.15.242.195:43213)
I20260807 15:24:09.190083 11665 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:57929
I20260807 15:24:09.198570 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:24:09.208732 11726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.200714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44870 (local address 127.15.242.254:35341)
0807 15:24:09.200916 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:09.200921 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:09.201082 (+ 161us) server_negotiation.cc:407] Connection header received
0807 15:24:09.201273 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:09.201276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:09.201328 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:09.201411 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:09.202229 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.202750 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.203657 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.203886 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.203988 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.205672 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:09.205677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:09.205679 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:09.205706 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:09.206887 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:09.207389 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:09.207393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:09.207394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:09.207476 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:09.207811 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:09.207814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:09.207816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:09.208025 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:09.208182 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:09.208456 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 15:24:09.208550 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260807 15:24:09.211609 11665 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44870:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:24:09.214694 11665 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:24:09.229563 12392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.224273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:43213 (local address 127.0.0.1:59914)
0807 15:24:09.225065 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:09.225081 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:09.225171 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:09.225831 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:09.225833 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:09.225847 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:09.225932 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.225938 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.226922 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.226929 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.228111 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.228121 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.229008 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.229012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.229117 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.229154 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 15:24:09.229270 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 15:24:09.229398 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"mutex_wait_us":27,"thread_start_us":97,"threads_started":1}
I20260807 15:24:09.229725 12389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.223536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37366 (local address 127.15.242.193:36517)
0807 15:24:09.224225 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:09.224233 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:09.224834 (+ 601us) server_negotiation.cc:407] Connection header received
0807 15:24:09.225156 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:09.225163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:09.225375 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:09.225533 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:09.225808 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.227043 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.228194 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.229103 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.229263 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.229414 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:09.229471 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 15:24:09.229567 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":95,"threads_started":1}
I20260807 15:24:09.230086 12393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.224445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59914 (local address 127.15.242.195:43213)
0807 15:24:09.225280 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:09.225291 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:09.225312 (+ 21us) server_negotiation.cc:407] Connection header received
0807 15:24:09.225381 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:09.225385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:09.225544 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:09.225688 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:09.226057 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.226791 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.228244 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.228890 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.229019 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.229162 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:09.229853 (+ 691us) server_negotiation.cc:299] Negotiation successful
0807 15:24:09.229959 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":174,"threads_started":1}
I20260807 15:24:09.229616 12387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.223424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36517 (local address 127.0.0.1:37366)
0807 15:24:09.224657 (+ 1233us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:09.224717 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:09.224962 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:09.225522 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:09.225528 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:09.225552 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:09.225686 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.225693 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.227192 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.227197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.228070 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.228079 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.229254 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.229261 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.229355 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.229377 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 15:24:09.229435 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 15:24:09.229491 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"mutex_wait_us":24,"spinlock_wait_cycles":7040,"thread_start_us":439,"threads_started":1}
I20260807 15:24:09.230829 12390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.223485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:42017 (local address 127.0.0.1:59696)
0807 15:24:09.224656 (+ 1171us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:09.224717 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:09.224962 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:09.225729 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:09.225732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:09.225750 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:09.225848 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.225854 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.227211 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.227224 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.229251 (+ 2027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.229261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.230410 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.230414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.230512 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.230535 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 15:24:09.230612 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 15:24:09.230684 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1126,"mutex_wait_us":37,"spinlock_wait_cycles":5248,"thread_start_us":93,"threads_started":1}
I20260807 15:24:09.230866 12391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.223724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59696 (local address 127.15.242.194:42017)
0807 15:24:09.224541 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:09.224555 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:09.224832 (+ 277us) server_negotiation.cc:407] Connection header received
0807 15:24:09.225192 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:09.225198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:09.225403 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:09.225548 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:09.225974 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.227072 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.229389 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.230301 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.230426 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.230554 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:09.230638 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 15:24:09.230730 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":161,"threads_started":1}
I20260807 15:24:09.233707 11851 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0c438c240a4480b98560a0c990eaee (DEFAULT_TABLE table=test-table [id=ed0c42dd885e42259fef09da71eedbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:09.233947 12043 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0c438c240a4480b98560a0c990eaee (DEFAULT_TABLE table=test-table [id=ed0c42dd885e42259fef09da71eedbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:09.234980 11851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0c438c240a4480b98560a0c990eaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:09.234980 12043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0c438c240a4480b98560a0c990eaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:09.235958 12279 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0c438c240a4480b98560a0c990eaee (DEFAULT_TABLE table=test-table [id=ed0c42dd885e42259fef09da71eedbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:09.236944 12279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0c438c240a4480b98560a0c990eaee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:09.242995 12397 tablet_bootstrap.cc:492] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: Bootstrap starting.
I20260807 15:24:09.243319 12394 tablet_bootstrap.cc:492] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4: Bootstrap starting.
I20260807 15:24:09.243747 12398 tablet_bootstrap.cc:492] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Bootstrap starting.
I20260807 15:24:09.246156 12398 tablet_bootstrap.cc:654] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:09.246156 12394 tablet_bootstrap.cc:654] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:09.246433 12397 tablet_bootstrap.cc:654] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:09.247290 12394 log.cc:824] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:09.247323 12398 log.cc:824] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:09.247665 12397 log.cc:824] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:09.249359 12394 tablet_bootstrap.cc:492] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4: No bootstrap required, opened a new log
I20260807 15:24:09.249476 12398 tablet_bootstrap.cc:492] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: No bootstrap required, opened a new log
I20260807 15:24:09.249573 12397 tablet_bootstrap.cc:492] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: No bootstrap required, opened a new log
I20260807 15:24:09.249603 12394 ts_tablet_manager.cc:1397] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260807 15:24:09.249683 12398 ts_tablet_manager.cc:1397] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260807 15:24:09.249725 12397 ts_tablet_manager.cc:1397] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 15:24:09.253015 12394 raft_consensus.cc:348] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.253332 12394 raft_consensus.cc:374] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:09.253394 12394 raft_consensus.cc:729] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac5e508be9ee4cacb89cacd762c9adc4, State: Initialized, Role: FOLLOWER
I20260807 15:24:09.253499 12398 raft_consensus.cc:348] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.253760 12398 raft_consensus.cc:374] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:09.253825 12398 raft_consensus.cc:729] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af7d66bde949462b9dade1e710d7ba5b, State: Initialized, Role: FOLLOWER
I20260807 15:24:09.253893 12394 consensus_queue.cc:260] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.254264 12398 consensus_queue.cc:260] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.254674 11943 heartbeater.cc:503] Master 127.15.242.254:35341 was elected leader, sending a full tablet report...
I20260807 15:24:09.254555 12397 raft_consensus.cc:348] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.254791 12397 raft_consensus.cc:374] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:09.254840 12397 raft_consensus.cc:729] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f63ff5636e27428aaeab35ae3fb88567, State: Initialized, Role: FOLLOWER
I20260807 15:24:09.254974 12394 ts_tablet_manager.cc:1428] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260807 15:24:09.255208 12398 ts_tablet_manager.cc:1428] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
I20260807 15:24:09.255281 12397 consensus_queue.cc:260] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.255577 12372 heartbeater.cc:503] Master 127.15.242.254:35341 was elected leader, sending a full tablet report...
I20260807 15:24:09.256032 12166 heartbeater.cc:503] Master 127.15.242.254:35341 was elected leader, sending a full tablet report...
I20260807 15:24:09.256739 12397 ts_tablet_manager.cc:1428] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260807 15:24:09.421052 12375 tablet.cc:2369] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:24:09.430296 12167 tablet.cc:2369] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:24:09.441597 11945 tablet.cc:2369] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:24:09.598444 12407 raft_consensus.cc:482] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:24:09.598649 12407 raft_consensus.cc:504] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.600183 12407 leader_election.cc:288] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac5e508be9ee4cacb89cacd762c9adc4 (127.15.242.193:36517), f63ff5636e27428aaeab35ae3fb88567 (127.15.242.194:42017)
I20260807 15:24:09.604326 12391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.600417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:43933 (local address 127.15.242.194:42017)
0807 15:24:09.600566 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:09.600572 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:09.600719 (+ 147us) server_negotiation.cc:407] Connection header received
0807 15:24:09.600865 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:09.600869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:09.600928 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:09.601013 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:09.601453 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.602107 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.603233 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.603702 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.603799 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.603861 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:09.604099 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 15:24:09.604183 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 15:24:09.604321 12410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.600151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:42017 (local address 127.15.242.195:43933)
0807 15:24:09.600621 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:09.600634 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:09.600726 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:09.601059 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:09.601062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:09.601099 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:09.601284 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.601292 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.602230 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.602233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.603085 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.603096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.603816 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.603821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.603928 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.603963 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 15:24:09.604074 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 15:24:09.604153 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":187,"spinlock_wait_cycles":8448,"thread_start_us":148,"threads_started":1}
I20260807 15:24:09.604494 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.600151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36517 (local address 127.15.242.195:57863)
0807 15:24:09.600504 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:09.600522 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:09.600631 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:09.601054 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:09.601058 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:09.601098 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:09.601298 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.601304 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.602125 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.602130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.603057 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:09.603067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.604024 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.604028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:09.604141 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.604163 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 15:24:09.604252 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 15:24:09.604320 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":36,"spinlock_wait_cycles":14336}
I20260807 15:24:09.604497 12389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.600304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:57863 (local address 127.15.242.193:36517)
0807 15:24:09.600468 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:09.600473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:09.600612 (+ 139us) server_negotiation.cc:407] Connection header received
0807 15:24:09.600865 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:09.600869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:09.600951 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:09.601025 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:09.601454 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.601973 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.603292 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.603872 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.603994 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.604061 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:09.604285 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 15:24:09.604380 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:24:09.605257 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0c438c240a4480b98560a0c990eaee" candidate_uuid: "af7d66bde949462b9dade1e710d7ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f63ff5636e27428aaeab35ae3fb88567" is_pre_election: true
I20260807 15:24:09.605347 11882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0c438c240a4480b98560a0c990eaee" candidate_uuid: "af7d66bde949462b9dade1e710d7ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" is_pre_election: true
I20260807 15:24:09.605576 12093 raft_consensus.cc:2454] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af7d66bde949462b9dade1e710d7ba5b in term 0.
I20260807 15:24:09.605638 11882 raft_consensus.cc:2454] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af7d66bde949462b9dade1e710d7ba5b in term 0.
I20260807 15:24:09.606137 12207 leader_election.cc:302] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: ac5e508be9ee4cacb89cacd762c9adc4, af7d66bde949462b9dade1e710d7ba5b, f63ff5636e27428aaeab35ae3fb88567; no voters:
I20260807 15:24:09.606421 12407 raft_consensus.cc:2781] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:24:09.606509 12407 raft_consensus.cc:482] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:24:09.606561 12407 raft_consensus.cc:3037] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:09.607584 12407 raft_consensus.cc:504] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.607920 12407 leader_election.cc:288] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [CANDIDATE]: Term 1 election: Requested vote from peers ac5e508be9ee4cacb89cacd762c9adc4 (127.15.242.193:36517), f63ff5636e27428aaeab35ae3fb88567 (127.15.242.194:42017)
I20260807 15:24:09.608263 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0c438c240a4480b98560a0c990eaee" candidate_uuid: "af7d66bde949462b9dade1e710d7ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f63ff5636e27428aaeab35ae3fb88567"
I20260807 15:24:09.608263 11882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0c438c240a4480b98560a0c990eaee" candidate_uuid: "af7d66bde949462b9dade1e710d7ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac5e508be9ee4cacb89cacd762c9adc4"
I20260807 15:24:09.608388 12093 raft_consensus.cc:3037] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:09.608388 11882 raft_consensus.cc:3037] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:09.609817 11882 raft_consensus.cc:2454] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af7d66bde949462b9dade1e710d7ba5b in term 1.
I20260807 15:24:09.609834 12093 raft_consensus.cc:2454] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af7d66bde949462b9dade1e710d7ba5b in term 1.
I20260807 15:24:09.610133 12207 leader_election.cc:302] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af7d66bde949462b9dade1e710d7ba5b, f63ff5636e27428aaeab35ae3fb88567; no voters:
I20260807 15:24:09.610319 12407 raft_consensus.cc:2781] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:09.610553 12407 raft_consensus.cc:686] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 1 LEADER]: Becoming Leader. State: Replica: af7d66bde949462b9dade1e710d7ba5b, State: Running, Role: LEADER
I20260807 15:24:09.610929 12407 consensus_queue.cc:237] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } }
I20260807 15:24:09.614410 11664 catalog_manager.cc:5495] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b reported cstate change: term changed from 0 to 1, leader changed from <none> to af7d66bde949462b9dade1e710d7ba5b (127.15.242.195). New cstate: current_term: 1 leader_uuid: "af7d66bde949462b9dade1e710d7ba5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af7d66bde949462b9dade1e710d7ba5b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 43213 } health_report { overall_health: HEALTHY } } }
I20260807 15:24:09.692425 12393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.688179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59916 (local address 127.15.242.195:43213)
0807 15:24:09.688326 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:09.688330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:09.688345 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:24:09.688440 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:09.688443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:09.688498 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:09.688590 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:09.689016 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.689552 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.690794 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:09.691035 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:09.691150 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:09.691545 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:09.691949 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:09.692089 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:09.692203 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 15:24:09.692278 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 15:24:09.698758 11882 raft_consensus.cc:1261] T 7f0c438c240a4480b98560a0c990eaee P ac5e508be9ee4cacb89cacd762c9adc4 [term 1 FOLLOWER]: Refusing update from remote peer af7d66bde949462b9dade1e710d7ba5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:09.698760 12093 raft_consensus.cc:1261] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 1 FOLLOWER]: Refusing update from remote peer af7d66bde949462b9dade1e710d7ba5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:09.699514 12414 consensus_queue.cc:1035] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f63ff5636e27428aaeab35ae3fb88567" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 42017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:09.699805 12407 consensus_queue.cc:1035] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac5e508be9ee4cacb89cacd762c9adc4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:09.707011 12418 mvcc.cc:205] Tried to move back new op lower bound from 7315932158758088704 to 7315932158409277440. Current Snapshot: MvccSnapshot[applied={T|T < 7315932158758088704}]
I20260807 15:24:09.709156 12419 mvcc.cc:205] Tried to move back new op lower bound from 7315932158758088704 to 7315932158409277440. Current Snapshot: MvccSnapshot[applied={T|T < 7315932158758088704}]
I20260807 15:24:09.710289 12420 mvcc.cc:205] Tried to move back new op lower bound from 7315932158758088704 to 7315932158409277440. Current Snapshot: MvccSnapshot[applied={T|T < 7315932158758088704}]
I20260807 15:24:09.716982 11664 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:09.717170 11664 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:09.719759 11664 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 458f301dac324853b8e5336a6f767066: Sending DeleteTablet for 3 replicas of tablet 7f0c438c240a4480b98560a0c990eaee
I20260807 15:24:09.720645 11851 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0c438c240a4480b98560a0c990eaee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:09 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:37366
I20260807 15:24:09.720671 12279 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0c438c240a4480b98560a0c990eaee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:09 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:59914
I20260807 15:24:09.720659 12043 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0c438c240a4480b98560a0c990eaee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:09 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:59696
I20260807 15:24:09.721266 12428 tablet_replica.cc:330] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: stopping tablet replica
I20260807 15:24:09.721598 12430 tablet_replica.cc:330] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: stopping tablet replica
I20260807 15:24:09.721632 12428 raft_consensus.cc:2229] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:24:09.721956 12430 raft_consensus.cc:2229] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:24:09.722023 12428 raft_consensus.cc:2258] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:09.722113 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 11759
I20260807 15:24:09.722337 12430 raft_consensus.cc:2258] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:09.754633 12428 ts_tablet_manager.cc:1905] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:09.757737 12428 ts_tablet_manager.cc:1918] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:09.757870 12428 log.cc:1196] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/7f0c438c240a4480b98560a0c990eaee
I20260807 15:24:09.758178 12428 ts_tablet_manager.cc:1939] T 7f0c438c240a4480b98560a0c990eaee P af7d66bde949462b9dade1e710d7ba5b: Deleting consensus metadata
I20260807 15:24:09.759538 11641 catalog_manager.cc:4841] TS af7d66bde949462b9dade1e710d7ba5b (127.15.242.195:43213): tablet 7f0c438c240a4480b98560a0c990eaee (table test-table [id=ed0c42dd885e42259fef09da71eedbe2]) successfully deleted
I20260807 15:24:09.760571 12430 ts_tablet_manager.cc:1905] T 7f0c438c240a4480b98560a0c990eaee P f63ff5636e27428aaeab35ae3fb88567: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 15:24:09.762307 11641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:36517 (error 108)
I20260807 15:24:09.762902 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 11950
I20260807 15:24:09.769882 12433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.769206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36517 (local address 127.0.0.1:37376)
0807 15:24:09.769662 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:09.769774 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:36517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":69,"threads_started":1}
W20260807 15:24:09.770076 11641 catalog_manager.cc:4584] TS ac5e508be9ee4cacb89cacd762c9adc4 (127.15.242.193:36517): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7f0c438c240a4480b98560a0c990eaee: Network error: Client connection negotiation failed: client connection to 127.15.242.193:36517: connect: Connection refused (error 111)
I20260807 15:24:09.778004 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 12173
I20260807 15:24:09.782121 12433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:09.778253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:42017 (local address 127.0.0.1:59710)
0807 15:24:09.781924 (+ 3671us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:09.782001 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.194:42017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3545}
I20260807 15:24:09.792021 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 11609
2026-08-07T15:24:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (3067 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T15:24:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:09Z Disabled control of system clock
I20260807 15:24:09.834559 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:46735
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:40843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:46735
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 15:24:09.956923 12444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:09.957361 12444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:09.957428 12444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:09.961953 12444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:09.962028 12444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:09.962049 12444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:09.962075 12444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:09.962095 12444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:09.967119 12444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:46735
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:46735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:09.968287 12444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:09.969791 12444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:09.979038 12458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:09.979018 12452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:09.979023 12450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:09.979138 12444 server_base.cc:1034] running on GCE node
I20260807 15:24:09.980052 12444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:09.981302 12444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:09.982481 12444 hybrid_clock.cc:648] HybridClock initialized: now 1786116249982461 us; error 29 us; skew 500 ppm
I20260807 15:24:09.988534 12444 webserver.cc:460] Webserver started at http://127.15.242.254:42523/ using document root <none> and password file <none>
I20260807 15:24:09.989262 12444 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:09.989342 12444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:09.989538 12444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:09.991796 12444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "18c605295eb5443585998c85774c9879"
format_stamp: "Formatted at 2026-08-07 15:24:09 on dist-test-slave-g170"
server_key: "61119f40da96775aca7ea43d2763bb32"
server_key_iv: "ba72282a37da52f058648e31ef25cb1b"
server_key_version: "encryptionkey@0"
I20260807 15:24:09.992367 12444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "18c605295eb5443585998c85774c9879"
format_stamp: "Formatted at 2026-08-07 15:24:09 on dist-test-slave-g170"
server_key: "61119f40da96775aca7ea43d2763bb32"
server_key_iv: "ba72282a37da52f058648e31ef25cb1b"
server_key_version: "encryptionkey@0"
I20260807 15:24:09.996563 12444 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260807 15:24:09.999518 12468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.001091 12444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:10.001315 12444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "18c605295eb5443585998c85774c9879"
format_stamp: "Formatted at 2026-08-07 15:24:09 on dist-test-slave-g170"
server_key: "61119f40da96775aca7ea43d2763bb32"
server_key_iv: "ba72282a37da52f058648e31ef25cb1b"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.001456 12444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:10.020012 12444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:10.020848 12444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:10.021060 12444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:10.028625 12444 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:46735
I20260807 15:24:10.028646 12549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:46735 every 8 connection(s)
I20260807 15:24:10.029738 12444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:10.032060 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 12444
I20260807 15:24:10.032207 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:10.032572 16331 external_mini_cluster.cc:1428] Setting key 4b3bb56af0bc5d70e0548e170d499118
I20260807 15:24:10.033641 12550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:10.040308 12550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879: Bootstrap starting.
I20260807 15:24:10.042855 12550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:10.042933 12554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.034281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50618 (local address 127.15.242.254:46735)
0807 15:24:10.035020 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.035038 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.035077 (+ 39us) server_negotiation.cc:407] Connection header received
0807 15:24:10.035807 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.035825 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.036262 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.036640 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:10.037149 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.038209 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.039218 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.039733 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.039926 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.040994 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:10.041000 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:10.041013 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:10.041453 (+ 440us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:10.041512 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:10.041535 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:10.041658 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.041836 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.042131 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":166,"threads_started":1}
I20260807 15:24:10.043742 12550 log.cc:824] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:10.046110 12550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879: No bootstrap required, opened a new log
I20260807 15:24:10.050288 12550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c605295eb5443585998c85774c9879" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 46735 } }
I20260807 15:24:10.050580 12550 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:10.050668 12550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c605295eb5443585998c85774c9879, State: Initialized, Role: FOLLOWER
I20260807 15:24:10.051122 12550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c605295eb5443585998c85774c9879" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 46735 } }
I20260807 15:24:10.051288 12550 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:10.051383 12550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:10.051496 12550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:10.052539 12550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c605295eb5443585998c85774c9879" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 46735 } }
I20260807 15:24:10.052950 12550 leader_election.cc:302] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18c605295eb5443585998c85774c9879; no voters:
I20260807 15:24:10.053367 12550 leader_election.cc:288] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:10.053460 12558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:10.053661 12558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [term 1 LEADER]: Becoming Leader. State: Replica: 18c605295eb5443585998c85774c9879, State: Running, Role: LEADER
I20260807 15:24:10.053990 12558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c605295eb5443585998c85774c9879" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 46735 } }
I20260807 15:24:10.054764 12550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:10.055928 12563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18c605295eb5443585998c85774c9879" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c605295eb5443585998c85774c9879" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 46735 } } }
I20260807 15:24:10.056114 12563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:10.056610 12570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:10.056628 12561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18c605295eb5443585998c85774c9879. Latest consensus state: current_term: 1 leader_uuid: "18c605295eb5443585998c85774c9879" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c605295eb5443585998c85774c9879" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 46735 } } }
I20260807 15:24:10.057348 12561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:10.060640 12570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:10.066849 12570 catalog_manager.cc:1347] Generated new cluster ID: 58e78087869d4348954b56962224d5c7
I20260807 15:24:10.066926 12570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:10.079787 12570 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:10.081089 12570 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:10.087100 12570 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879: Generated new TSK 0
I20260807 15:24:10.087774 12570 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:10.099972 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:46735
--builtin_ntp_servers=127.15.242.212:40843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 15:24:10.217999 12587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:10.218274 12587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:10.218314 12587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:10.222414 12587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:10.222467 12587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:10.222545 12587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:24:10.227355 12587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:10.228472 12587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:10.229954 12587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:10.240139 12597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:10.240234 12595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:10.240202 12594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:10.240357 12587 server_base.cc:1034] running on GCE node
I20260807 15:24:10.241267 12587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:10.241886 12587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:10.243062 12587 hybrid_clock.cc:648] HybridClock initialized: now 1786116250243031 us; error 39 us; skew 500 ppm
I20260807 15:24:10.245177 12587 webserver.cc:460] Webserver started at http://127.15.242.193:36511/ using document root <none> and password file <none>
I20260807 15:24:10.245759 12587 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:10.245826 12587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:10.246050 12587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:10.248394 12587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "632871f48c124aaca9864e435c41c7bc"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "5c5f88060828065400328fd5d5f5750e"
server_key_iv: "071f9cb71f7a6643fdd528e439b37065"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.249017 12587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "632871f48c124aaca9864e435c41c7bc"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "5c5f88060828065400328fd5d5f5750e"
server_key_iv: "071f9cb71f7a6643fdd528e439b37065"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.252919 12587 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:24:10.255637 12606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.257153 12587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:10.257267 12587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "632871f48c124aaca9864e435c41c7bc"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "5c5f88060828065400328fd5d5f5750e"
server_key_iv: "071f9cb71f7a6643fdd528e439b37065"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.257381 12587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:10.290616 12587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:10.291385 12587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:10.291586 12587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:10.292250 12587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:10.293303 12587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:10.293354 12587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.293395 12587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:10.293448 12587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.303158 12587 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:40101
I20260807 15:24:10.303220 12784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:40101 every 8 connection(s)
I20260807 15:24:10.304134 12587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:24:10.308029 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 12587
I20260807 15:24:10.308197 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:24:10.308518 16331 external_mini_cluster.cc:1428] Setting key 7675a22c22022c7e2a18a5ffffdf5f24
I20260807 15:24:10.310840 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:46735
--builtin_ntp_servers=127.15.242.212:40843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 15:24:10.315508 12554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.306219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:44945 (local address 127.15.242.254:46735)
0807 15:24:10.306352 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.306356 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.307551 (+ 1195us) server_negotiation.cc:407] Connection header received
0807 15:24:10.309521 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.309524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.309582 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.309665 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:10.310873 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.311514 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.313191 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.313595 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.313729 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.314855 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:10.314861 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:10.314867 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:10.314886 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:10.314912 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:10.314926 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:10.315010 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.315217 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.315295 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:24:10.316308 12789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.306666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:46735 (local address 127.15.242.193:44945)
0807 15:24:10.307387 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:10.307430 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:10.309308 (+ 1878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:10.309840 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:10.309847 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:10.309969 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:10.310696 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.310722 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.311659 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.311666 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.313064 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.313074 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.313761 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.313764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.313910 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.314563 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:10.314565 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:10.314615 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:10.314684 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:10.315054 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:10.315063 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:10.315070 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 15:24:10.315193 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 15:24:10.315439 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":136,"threads_started":1}
I20260807 15:24:10.317588 12785 heartbeater.cc:347] Connected to a master server at 127.15.242.254:46735
I20260807 15:24:10.317844 12785 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:10.318392 12785 heartbeater.cc:511] Master 127.15.242.254:46735 requested a full tablet report, sending...
I20260807 15:24:10.319875 12493 ts_manager.cc:194] Registered new tserver with Master: 632871f48c124aaca9864e435c41c7bc (127.15.242.193:40101)
I20260807 15:24:10.321082 12493 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.193:44945
W20260807 15:24:10.430438 12791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:10.430703 12791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:10.430743 12791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:10.434831 12791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:10.434894 12791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:10.434948 12791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:24:10.440282 12791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:10.441535 12791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:10.443075 12791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:10.454057 12800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:10.454062 12798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:10.454159 12802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:10.454356 12791 server_base.cc:1034] running on GCE node
I20260807 15:24:10.455003 12791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:10.455693 12791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:10.456840 12791 hybrid_clock.cc:648] HybridClock initialized: now 1786116250456804 us; error 54 us; skew 500 ppm
I20260807 15:24:10.459112 12791 webserver.cc:460] Webserver started at http://127.15.242.194:39491/ using document root <none> and password file <none>
I20260807 15:24:10.459723 12791 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:10.459789 12791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:10.459980 12791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:10.462307 12791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "66906c52ebfd4056a3cbfcb918c484d9"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "036223e697bb41255fcd525868514603"
server_key_iv: "ca29c0ea97d5945dafa43d152d3f8432"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.462893 12791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "66906c52ebfd4056a3cbfcb918c484d9"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "036223e697bb41255fcd525868514603"
server_key_iv: "ca29c0ea97d5945dafa43d152d3f8432"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.467015 12791 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:10.469784 12809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.471088 12791 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:10.471251 12791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "66906c52ebfd4056a3cbfcb918c484d9"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "036223e697bb41255fcd525868514603"
server_key_iv: "ca29c0ea97d5945dafa43d152d3f8432"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.471370 12791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:10.488597 12791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:10.489444 12791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:10.489657 12791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:10.490307 12791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:10.491299 12791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:10.491374 12791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.491452 12791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:10.491492 12791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.503378 12791 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:45731
I20260807 15:24:10.503399 13000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:45731 every 8 connection(s)
I20260807 15:24:10.504374 12791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:24:10.509482 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 12791
I20260807 15:24:10.509634 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:24:10.509944 16331 external_mini_cluster.cc:1428] Setting key 294809ccbd916b0f75e77872427b6c29
I20260807 15:24:10.511978 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:46735
--builtin_ntp_servers=127.15.242.212:40843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 15:24:10.515451 12554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.506457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:53217 (local address 127.15.242.254:46735)
0807 15:24:10.506606 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.506609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.507757 (+ 1148us) server_negotiation.cc:407] Connection header received
0807 15:24:10.509687 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.509692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.509774 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.509890 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:10.511094 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.511830 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.513290 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.513534 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.513670 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.514895 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:10.514898 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:10.514900 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:10.514914 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:10.514933 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:10.514942 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:10.515026 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.515227 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.515295 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:24:10.516422 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.506837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:46735 (local address 127.15.242.194:53217)
0807 15:24:10.507556 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:10.507598 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:10.509230 (+ 1632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:10.510149 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:10.510157 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:10.510254 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:10.510933 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.510950 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.511979 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.511988 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.513144 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.513156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.513710 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.513715 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.513906 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.514600 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:10.514602 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:10.514649 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:10.514721 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:10.515028 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:10.515043 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:10.515051 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 15:24:10.515227 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 15:24:10.515549 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":126,"threads_started":1}
I20260807 15:24:10.517714 13002 heartbeater.cc:347] Connected to a master server at 127.15.242.254:46735
I20260807 15:24:10.518003 13002 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:10.518756 13002 heartbeater.cc:511] Master 127.15.242.254:46735 requested a full tablet report, sending...
I20260807 15:24:10.520053 12493 ts_manager.cc:194] Registered new tserver with Master: 66906c52ebfd4056a3cbfcb918c484d9 (127.15.242.194:45731)
I20260807 15:24:10.520978 12493 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.194:53217
W20260807 15:24:10.632046 13009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:10.632316 13009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:10.632357 13009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:10.636300 13009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:10.636354 13009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:10.636407 13009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:24:10.642127 13009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:40843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:10.643342 13009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:10.644903 13009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:10.655416 13022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:10.655426 13019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:10.655457 13020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:10.655586 13009 server_base.cc:1034] running on GCE node
I20260807 15:24:10.656083 13009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:10.656726 13009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:10.657967 13009 hybrid_clock.cc:648] HybridClock initialized: now 1786116250657950 us; error 30 us; skew 500 ppm
I20260807 15:24:10.659955 13009 webserver.cc:460] Webserver started at http://127.15.242.195:39315/ using document root <none> and password file <none>
I20260807 15:24:10.660545 13009 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:10.660637 13009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:10.660938 13009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:10.663079 13009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "d67ee935f8314665947dd18d713e3d21"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "7a3296f4ee5d48aba56533d8cb06dc67"
server_key_iv: "982221e40aa39f50d10de19c66a4d338"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.663714 13009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "d67ee935f8314665947dd18d713e3d21"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "7a3296f4ee5d48aba56533d8cb06dc67"
server_key_iv: "982221e40aa39f50d10de19c66a4d338"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.667423 13009 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260807 15:24:10.670040 13031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.671307 13009 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 15:24:10.671443 13009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "d67ee935f8314665947dd18d713e3d21"
format_stamp: "Formatted at 2026-08-07 15:24:10 on dist-test-slave-g170"
server_key: "7a3296f4ee5d48aba56533d8cb06dc67"
server_key_iv: "982221e40aa39f50d10de19c66a4d338"
server_key_version: "encryptionkey@0"
I20260807 15:24:10.671551 13009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:10.691121 13009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:10.691819 13009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:10.692020 13009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:10.692613 13009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:10.693612 13009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:10.693681 13009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.693760 13009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:10.693800 13009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:10.702894 13009 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:35451
I20260807 15:24:10.702934 13203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:35451 every 8 connection(s)
I20260807 15:24:10.703841 13009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:24:10.710016 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 13009
I20260807 15:24:10.710180 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:24:10.710554 16331 external_mini_cluster.cc:1428] Setting key 5018bcdec47762818f4f19f2e12cf64d
I20260807 15:24:10.714841 12554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.705869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:54781 (local address 127.15.242.254:46735)
0807 15:24:10.706022 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.706026 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.707278 (+ 1252us) server_negotiation.cc:407] Connection header received
0807 15:24:10.708906 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.708909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.708959 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.709045 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:10.710058 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.711006 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.712711 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.713158 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.713280 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.714392 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:10.714396 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:10.714398 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:10.714410 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:10.714428 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:10.714436 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:10.714501 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.714676 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.714728 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 15:24:10.715752 13206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.706315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:46735 (local address 127.15.242.195:54781)
0807 15:24:10.707120 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:10.707168 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:10.708618 (+ 1450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:10.709270 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:10.709278 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:10.709364 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:10.709854 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.709867 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.711255 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.711259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.712526 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.712539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.713311 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.713315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.713456 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.714102 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:10.714103 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:10.714144 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:10.714208 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:10.714514 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:10.714521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:10.714526 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 15:24:10.714621 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 15:24:10.714876 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":127,"threads_started":1}
I20260807 15:24:10.717070 13204 heartbeater.cc:347] Connected to a master server at 127.15.242.254:46735
I20260807 15:24:10.717346 13204 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:10.717887 13204 heartbeater.cc:511] Master 127.15.242.254:46735 requested a full tablet report, sending...
I20260807 15:24:10.719033 12493 ts_manager.cc:194] Registered new tserver with Master: d67ee935f8314665947dd18d713e3d21 (127.15.242.195:35451)
I20260807 15:24:10.719743 12493 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.195:54781
I20260807 15:24:10.724714 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:24:10.731191 12554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.726756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50628 (local address 127.15.242.254:46735)
0807 15:24:10.726884 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.726888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.727151 (+ 263us) server_negotiation.cc:407] Connection header received
0807 15:24:10.727304 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.727307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.727355 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.727453 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:10.727741 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.728288 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.729294 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.729544 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.729669 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.730552 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:10.730557 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:10.730560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:10.730574 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:10.730648 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:10.730659 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:10.730814 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.731000 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.731040 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 15:24:10.734277 12493 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:24:10.737658 12493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:24:10.753065 13219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.746943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44174 (local address 127.15.242.195:35451)
0807 15:24:10.748023 (+ 1080us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.748037 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.748066 (+ 29us) server_negotiation.cc:407] Connection header received
0807 15:24:10.748152 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.748178 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.748408 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.748580 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:10.748994 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.750003 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.751400 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.751949 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.752029 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.752170 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.752674 (+ 504us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.752829 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":963,"thread_start_us":226,"threads_started":1}
I20260807 15:24:10.753539 13218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.746716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:35451 (local address 127.0.0.1:44174)
0807 15:24:10.747172 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:10.747237 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:10.747477 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:10.748623 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:10.748630 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:10.748655 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:10.748839 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.748847 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.750111 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.750116 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.751251 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.751263 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.752286 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.752291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.752424 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.752480 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 15:24:10.753258 (+ 778us) client_negotiation.cc:240] Negotiation successful
0807 15:24:10.753393 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":97,"threads_started":1}
I20260807 15:24:10.753988 13221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.747197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:45731 (local address 127.0.0.1:38334)
0807 15:24:10.748223 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:10.748244 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:10.748361 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:10.749076 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:10.749078 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:10.749093 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:10.749190 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.749196 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.750767 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.750771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.752137 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.752149 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.753525 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.753529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.753626 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.753655 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 15:24:10.753748 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 15:24:10.753817 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":32,"thread_start_us":161,"threads_started":1}
I20260807 15:24:10.754558 13222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.747536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38334 (local address 127.15.242.194:45731)
0807 15:24:10.748024 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.748037 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.748476 (+ 439us) server_negotiation.cc:407] Connection header received
0807 15:24:10.748571 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.748577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.748814 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.748996 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:10.749315 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.750614 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.752290 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.753284 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.753415 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.753595 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.754224 (+ 629us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.754335 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":162,"threads_started":1}
I20260807 15:24:10.755308 13223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.748156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:40101 (local address 127.0.0.1:44598)
0807 15:24:10.748870 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:10.748886 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:10.748971 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:10.749683 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:10.749686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:10.749704 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:10.749783 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.749789 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.751271 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.751275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.752532 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.752542 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.754506 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.754513 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.754781 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.754809 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 15:24:10.755096 (+ 287us) client_negotiation.cc:240] Negotiation successful
0807 15:24:10.755176 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":1,"thread_start_us":130,"threads_started":1}
I20260807 15:24:10.755412 13224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.748700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44598 (local address 127.15.242.193:40101)
0807 15:24:10.749162 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.749175 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.749199 (+ 24us) server_negotiation.cc:407] Connection header received
0807 15:24:10.749303 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.749309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.749514 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.749694 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:10.749898 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.751124 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.752686 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.753843 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.753968 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.754428 (+ 460us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.755142 (+ 714us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.755254 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":136,"threads_started":1}
I20260807 15:24:10.757256 13108 tablet_service.cc:1467] Processing CreateTablet for tablet 00964d246b7243e0bc661d9626cfb31f (DEFAULT_TABLE table=test-table [id=e9ddc842d1a74178a11c7b234c855d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:10.757830 12882 tablet_service.cc:1467] Processing CreateTablet for tablet 00964d246b7243e0bc661d9626cfb31f (DEFAULT_TABLE table=test-table [id=e9ddc842d1a74178a11c7b234c855d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:10.758514 13108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00964d246b7243e0bc661d9626cfb31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:10.758479 12676 tablet_service.cc:1467] Processing CreateTablet for tablet 00964d246b7243e0bc661d9626cfb31f (DEFAULT_TABLE table=test-table [id=e9ddc842d1a74178a11c7b234c855d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:10.758910 12882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00964d246b7243e0bc661d9626cfb31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:10.759455 12676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00964d246b7243e0bc661d9626cfb31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:10.765743 13225 tablet_bootstrap.cc:492] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Bootstrap starting.
I20260807 15:24:10.767068 13229 tablet_bootstrap.cc:492] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc: Bootstrap starting.
I20260807 15:24:10.767328 13228 tablet_bootstrap.cc:492] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Bootstrap starting.
I20260807 15:24:10.768900 13225 tablet_bootstrap.cc:654] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:10.769294 13228 tablet_bootstrap.cc:654] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:10.769320 13229 tablet_bootstrap.cc:654] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:10.770071 13228 log.cc:824] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:10.770130 13225 log.cc:824] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:10.770119 13229 log.cc:824] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:10.771908 13225 tablet_bootstrap.cc:492] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: No bootstrap required, opened a new log
I20260807 15:24:10.772074 13229 tablet_bootstrap.cc:492] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc: No bootstrap required, opened a new log
I20260807 15:24:10.772074 13228 tablet_bootstrap.cc:492] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: No bootstrap required, opened a new log
I20260807 15:24:10.772145 13225 ts_tablet_manager.cc:1397] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 15:24:10.772265 13229 ts_tablet_manager.cc:1397] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 15:24:10.772265 13228 ts_tablet_manager.cc:1397] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 15:24:10.775831 13225 raft_consensus.cc:348] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.776508 13225 raft_consensus.cc:374] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:10.776583 13225 raft_consensus.cc:729] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d67ee935f8314665947dd18d713e3d21, State: Initialized, Role: FOLLOWER
I20260807 15:24:10.776715 13228 raft_consensus.cc:348] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.776996 13228 raft_consensus.cc:374] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:10.777056 13228 raft_consensus.cc:729] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66906c52ebfd4056a3cbfcb918c484d9, State: Initialized, Role: FOLLOWER
I20260807 15:24:10.777087 13225 consensus_queue.cc:260] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.777546 13228 consensus_queue.cc:260] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.777443 13229 raft_consensus.cc:348] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.777697 13229 raft_consensus.cc:374] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:10.777771 13229 raft_consensus.cc:729] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632871f48c124aaca9864e435c41c7bc, State: Initialized, Role: FOLLOWER
I20260807 15:24:10.777839 13204 heartbeater.cc:503] Master 127.15.242.254:46735 was elected leader, sending a full tablet report...
I20260807 15:24:10.778168 13225 ts_tablet_manager.cc:1428] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260807 15:24:10.778175 13229 consensus_queue.cc:260] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.778868 12785 heartbeater.cc:503] Master 127.15.242.254:46735 was elected leader, sending a full tablet report...
I20260807 15:24:10.779182 13229 ts_tablet_manager.cc:1428] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:24:10.779254 13228 ts_tablet_manager.cc:1428] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:24:10.779605 13002 heartbeater.cc:503] Master 127.15.242.254:46735 was elected leader, sending a full tablet report...
W20260807 15:24:10.805464 12786 tablet.cc:2369] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:24:10.942109 13235 raft_consensus.cc:482] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:24:10.942375 13235 raft_consensus.cc:504] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.943686 13235 leader_election.cc:288] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d67ee935f8314665947dd18d713e3d21 (127.15.242.195:35451), 632871f48c124aaca9864e435c41c7bc (127.15.242.193:40101)
I20260807 15:24:10.948587 13219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.944160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:42899 (local address 127.15.242.195:35451)
0807 15:24:10.944334 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.944338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.944476 (+ 138us) server_negotiation.cc:407] Connection header received
0807 15:24:10.944812 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.944816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.944880 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.944984 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:10.945436 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.946120 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.947365 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.947948 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.948100 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.948162 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.948377 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.948450 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 15:24:10.948590 13007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.944155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:35451 (local address 127.15.242.194:42899)
0807 15:24:10.944372 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:10.944391 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:10.944499 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:10.945034 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:10.945037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:10.945085 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:10.945290 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.945298 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.946263 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.946267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.947221 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.947232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.948104 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.948109 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.948237 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.948262 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 15:24:10.948358 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 15:24:10.948441 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":3,"spinlock_wait_cycles":5248}
I20260807 15:24:10.948822 13224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.944649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:53133 (local address 127.15.242.193:40101)
0807 15:24:10.944826 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.944831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.945114 (+ 283us) server_negotiation.cc:407] Connection header received
0807 15:24:10.945257 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.945260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.945315 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.945404 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:10.945751 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.946334 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.947575 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.948125 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.948317 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.948370 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.948570 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.948656 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 15:24:10.949005 13237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.944507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:40101 (local address 127.15.242.194:53133)
0807 15:24:10.944994 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:10.945010 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:10.945132 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:10.945429 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:10.945433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:10.945452 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:10.945580 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.945587 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.946462 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.946464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.947403 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:10.947415 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.948317 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.948322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:10.948432 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.948458 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 15:24:10.948552 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 15:24:10.948625 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"spinlock_wait_cycles":896,"thread_start_us":185,"threads_started":1}
I20260807 15:24:10.949330 13135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00964d246b7243e0bc661d9626cfb31f" candidate_uuid: "66906c52ebfd4056a3cbfcb918c484d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d67ee935f8314665947dd18d713e3d21" is_pre_election: true
I20260807 15:24:10.949683 13135 raft_consensus.cc:2454] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66906c52ebfd4056a3cbfcb918c484d9 in term 0.
I20260807 15:24:10.949826 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00964d246b7243e0bc661d9626cfb31f" candidate_uuid: "66906c52ebfd4056a3cbfcb918c484d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632871f48c124aaca9864e435c41c7bc" is_pre_election: true
I20260807 15:24:10.950129 12712 raft_consensus.cc:2454] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66906c52ebfd4056a3cbfcb918c484d9 in term 0.
I20260807 15:24:10.950294 12815 leader_election.cc:302] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66906c52ebfd4056a3cbfcb918c484d9, d67ee935f8314665947dd18d713e3d21; no voters:
I20260807 15:24:10.950610 13235 raft_consensus.cc:2781] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:24:10.950699 13235 raft_consensus.cc:482] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:24:10.950734 13235 raft_consensus.cc:3037] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:10.951897 13235 raft_consensus.cc:504] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.952279 13235 leader_election.cc:288] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [CANDIDATE]: Term 1 election: Requested vote from peers d67ee935f8314665947dd18d713e3d21 (127.15.242.195:35451), 632871f48c124aaca9864e435c41c7bc (127.15.242.193:40101)
I20260807 15:24:10.952636 13135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00964d246b7243e0bc661d9626cfb31f" candidate_uuid: "66906c52ebfd4056a3cbfcb918c484d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d67ee935f8314665947dd18d713e3d21"
I20260807 15:24:10.952742 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00964d246b7243e0bc661d9626cfb31f" candidate_uuid: "66906c52ebfd4056a3cbfcb918c484d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "632871f48c124aaca9864e435c41c7bc"
I20260807 15:24:10.952807 13135 raft_consensus.cc:3037] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:10.952920 12712 raft_consensus.cc:3037] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:10.954005 13135 raft_consensus.cc:2454] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66906c52ebfd4056a3cbfcb918c484d9 in term 1.
I20260807 15:24:10.954072 12712 raft_consensus.cc:2454] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66906c52ebfd4056a3cbfcb918c484d9 in term 1.
I20260807 15:24:10.954330 12815 leader_election.cc:302] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66906c52ebfd4056a3cbfcb918c484d9, d67ee935f8314665947dd18d713e3d21; no voters:
I20260807 15:24:10.954553 13235 raft_consensus.cc:2781] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:10.954833 13235 raft_consensus.cc:686] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 1 LEADER]: Becoming Leader. State: Replica: 66906c52ebfd4056a3cbfcb918c484d9, State: Running, Role: LEADER
W20260807 15:24:10.954825 13205 tablet.cc:2369] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:24:10.955269 13235 consensus_queue.cc:237] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } }
I20260807 15:24:10.959453 12486 catalog_manager.cc:5495] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66906c52ebfd4056a3cbfcb918c484d9 (127.15.242.194). New cstate: current_term: 1 leader_uuid: "66906c52ebfd4056a3cbfcb918c484d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66906c52ebfd4056a3cbfcb918c484d9" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 45731 } health_report { overall_health: HEALTHY } } }
I20260807 15:24:10.992168 13222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:10.988351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38342 (local address 127.15.242.194:45731)
0807 15:24:10.988485 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:10.988489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:10.988505 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:24:10.988692 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:10.988695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:10.988799 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:10.988923 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:10.989186 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.989785 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.990648 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:10.990867 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:10.990974 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:10.991308 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:10.991738 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:10.991894 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:10.991989 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 15:24:10.992028 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 15:24:10.998718 13135 raft_consensus.cc:1261] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 1 FOLLOWER]: Refusing update from remote peer 66906c52ebfd4056a3cbfcb918c484d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:10.998718 12712 raft_consensus.cc:1261] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc [term 1 FOLLOWER]: Refusing update from remote peer 66906c52ebfd4056a3cbfcb918c484d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:10.999534 13238 consensus_queue.cc:1035] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d67ee935f8314665947dd18d713e3d21" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 35451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:10.999744 13235 consensus_queue.cc:1035] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "632871f48c124aaca9864e435c41c7bc" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 40101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 15:24:11.005904 13006 tablet.cc:2369] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:24:11.008611 13244 mvcc.cc:205] Tried to move back new op lower bound from 7315932164082495488 to 7315932163915911168. Current Snapshot: MvccSnapshot[applied={T|T < 7315932164082495488}]
I20260807 15:24:11.018728 12486 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:11.018936 12486 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:11.021735 12486 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 18c605295eb5443585998c85774c9879: Sending DeleteTablet for 3 replicas of tablet 00964d246b7243e0bc661d9626cfb31f
I20260807 15:24:11.022712 13108 tablet_service.cc:1514] Processing DeleteTablet for tablet 00964d246b7243e0bc661d9626cfb31f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:11 UTC) from {username='slave'} at 127.0.0.1:44174
I20260807 15:24:11.022712 12882 tablet_service.cc:1514] Processing DeleteTablet for tablet 00964d246b7243e0bc661d9626cfb31f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:11 UTC) from {username='slave'} at 127.0.0.1:38334
I20260807 15:24:11.023324 12676 tablet_service.cc:1514] Processing DeleteTablet for tablet 00964d246b7243e0bc661d9626cfb31f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:11 UTC) from {username='slave'} at 127.0.0.1:44598
I20260807 15:24:11.023801 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 12587
I20260807 15:24:11.023870 13266 tablet_replica.cc:330] T 00964d246b7243e0bc661d9626cfb31f P 632871f48c124aaca9864e435c41c7bc: stopping tablet replica
I20260807 15:24:11.023983 13264 tablet_replica.cc:330] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: stopping tablet replica
I20260807 15:24:11.023445 13262 tablet_replica.cc:330] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: stopping tablet replica
I20260807 15:24:11.032807 13262 raft_consensus.cc:2229] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:24:11.032805 13264 raft_consensus.cc:2229] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:24:11.033293 13262 raft_consensus.cc:2258] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:11.033306 13264 raft_consensus.cc:2258] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:11.035503 13262 ts_tablet_manager.cc:1905] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:11.039371 13262 ts_tablet_manager.cc:1918] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:11.039494 13262 log.cc:1196] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/00964d246b7243e0bc661d9626cfb31f
I20260807 15:24:11.039858 13262 ts_tablet_manager.cc:1939] T 00964d246b7243e0bc661d9626cfb31f P 66906c52ebfd4056a3cbfcb918c484d9: Deleting consensus metadata
I20260807 15:24:11.041378 12469 catalog_manager.cc:4841] TS 66906c52ebfd4056a3cbfcb918c484d9 (127.15.242.194:45731): tablet 00964d246b7243e0bc661d9626cfb31f (table test-table [id=e9ddc842d1a74178a11c7b234c855d92]) successfully deleted
I20260807 15:24:11.043120 13264 ts_tablet_manager.cc:1905] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 15:24:11.044158 12473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:40101 (error 108)
I20260807 15:24:11.045190 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 12791
I20260807 15:24:11.054785 13223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:11.054004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:40101 (local address 127.0.0.1:44604)
0807 15:24:11.054538 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:11.054654 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:40101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399}
W20260807 15:24:11.055074 12473 catalog_manager.cc:4584] TS 632871f48c124aaca9864e435c41c7bc (127.15.242.193:40101): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 00964d246b7243e0bc661d9626cfb31f: Network error: Client connection negotiation failed: client connection to 127.15.242.193:40101: connect: Connection refused (error 111)
I20260807 15:24:11.060631 13264 ts_tablet_manager.cc:1918] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:11.060766 13264 log.cc:1196] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/00964d246b7243e0bc661d9626cfb31f
I20260807 15:24:11.061131 13264 ts_tablet_manager.cc:1939] T 00964d246b7243e0bc661d9626cfb31f P d67ee935f8314665947dd18d713e3d21: Deleting consensus metadata
I20260807 15:24:11.063328 12473 catalog_manager.cc:4841] TS d67ee935f8314665947dd18d713e3d21 (127.15.242.195:35451): tablet 00964d246b7243e0bc661d9626cfb31f (table test-table [id=e9ddc842d1a74178a11c7b234c855d92]) successfully deleted
I20260807 15:24:11.073328 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 13009
I20260807 15:24:11.087620 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 12444
2026-08-07T15:24:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1295 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:11 dist-test-slave-g170 krb5kdc[13272](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:11 dist-test-slave-g170 krb5kdc[13272](info): set up 2 sockets
Aug 07 15:24:11 dist-test-slave-g170 krb5kdc[13272](info): commencing operation
krb5kdc: starting...
W20260807 15:24:12.423988 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:12 dist-test-slave-g170 krb5kdc[13272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:12.559999 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:33595
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:33595
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:12.674122 13292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:12.674418 13292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:12.674489 13292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:12.678454 13292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:12.678537 13292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:12.678574 13292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:12.678625 13292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:12.678669 13292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:12.688277 13292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:33595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:33595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:12.690593 13292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:12.691814 13292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:12.701143 13299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:12.701150 13303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:12.701164 13300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:12.701508 13292 server_base.cc:1034] running on GCE node
I20260807 15:24:12.702068 13292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:12.703184 13292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:12.704353 13292 hybrid_clock.cc:648] HybridClock initialized: now 1786116252704332 us; error 33 us; skew 500 ppm
Aug 07 15:24:12 dist-test-slave-g170 krb5kdc[13272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116252, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:12.707305 13292 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:12.708248 13292 webserver.cc:460] Webserver started at http://127.15.242.254:46729/ using document root <none> and password file <none>
I20260807 15:24:12.708839 13292 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:12.708910 13292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:12.709091 13292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:12.711166 13292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "665bfce3312447c8b2d4b56d2c18e7a8"
format_stamp: "Formatted at 2026-08-07 15:24:12 on dist-test-slave-g170"
server_key: "4f10ba3a98b78d79f3d957e1f4f8b9a9"
server_key_iv: "2f9ab922ce05196100d10a8d86f13d61"
server_key_version: "encryptionkey@0"
I20260807 15:24:12.711700 13292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "665bfce3312447c8b2d4b56d2c18e7a8"
format_stamp: "Formatted at 2026-08-07 15:24:12 on dist-test-slave-g170"
server_key: "4f10ba3a98b78d79f3d957e1f4f8b9a9"
server_key_iv: "2f9ab922ce05196100d10a8d86f13d61"
server_key_version: "encryptionkey@0"
I20260807 15:24:12.715857 13292 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 15:24:12.718509 13311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:12.719864 13292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:24:12.720001 13292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "665bfce3312447c8b2d4b56d2c18e7a8"
format_stamp: "Formatted at 2026-08-07 15:24:12 on dist-test-slave-g170"
server_key: "4f10ba3a98b78d79f3d957e1f4f8b9a9"
server_key_iv: "2f9ab922ce05196100d10a8d86f13d61"
server_key_version: "encryptionkey@0"
I20260807 15:24:12.720115 13292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:12.740026 13292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:12.743420 13292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:12.743655 13292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:12.751396 13292 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:33595
I20260807 15:24:12.751422 13390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:33595 every 8 connection(s)
I20260807 15:24:12.752393 13292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:12.755326 13391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:12.757576 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 13292
I20260807 15:24:12.757735 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:12.758091 16331 external_mini_cluster.cc:1428] Setting key 653a9010b29da753d9f37dcbded29383
I20260807 15:24:12.762426 13391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8: Bootstrap starting.
I20260807 15:24:12.764807 13391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:12.765627 13391 log.cc:824] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8: Log is configured to *not* fsync() on all Append() calls
Aug 07 15:24:12 dist-test-slave-g170 krb5kdc[13272](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:12.767632 13391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8: No bootstrap required, opened a new log
I20260807 15:24:12.771363 13391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "665bfce3312447c8b2d4b56d2c18e7a8" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33595 } }
I20260807 15:24:12.771631 13391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:12.771700 13391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 665bfce3312447c8b2d4b56d2c18e7a8, State: Initialized, Role: FOLLOWER
I20260807 15:24:12.772199 13391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "665bfce3312447c8b2d4b56d2c18e7a8" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33595 } }
I20260807 15:24:12.772338 13391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:12.772425 13391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:12.772542 13391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:12.772660 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:12.759598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45638 (local address 127.15.242.254:33595)
0807 15:24:12.760069 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:12.760084 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:12.760121 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:24:12.760809 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:12.760828 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:12.761151 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:12.761508 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:12.762382 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:12.763408 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:12.764283 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:12.764808 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:12.764987 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:12.767501 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:12.767506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:12.767521 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:12.767549 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:12.769610 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:12.770089 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:12.770095 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:12.770099 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:12.770209 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:12.770516 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:12.770519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:12.770521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:12.770923 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:12.771138 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:12.771443 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 15:24:12.771773 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":159,"threads_started":1}
I20260807 15:24:12.773635 13391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "665bfce3312447c8b2d4b56d2c18e7a8" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33595 } }
I20260807 15:24:12.773986 13391 leader_election.cc:302] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 665bfce3312447c8b2d4b56d2c18e7a8; no voters:
I20260807 15:24:12.774326 13391 leader_election.cc:288] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:12.774401 13396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:12.774622 13396 raft_consensus.cc:686] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [term 1 LEADER]: Becoming Leader. State: Replica: 665bfce3312447c8b2d4b56d2c18e7a8, State: Running, Role: LEADER
I20260807 15:24:12.774932 13396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "665bfce3312447c8b2d4b56d2c18e7a8" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33595 } }
I20260807 15:24:12.775663 13391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:12.776139 13396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "665bfce3312447c8b2d4b56d2c18e7a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "665bfce3312447c8b2d4b56d2c18e7a8" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33595 } } }
I20260807 15:24:12.776262 13396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:12.776584 13400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 665bfce3312447c8b2d4b56d2c18e7a8. Latest consensus state: current_term: 1 leader_uuid: "665bfce3312447c8b2d4b56d2c18e7a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "665bfce3312447c8b2d4b56d2c18e7a8" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 33595 } } }
I20260807 15:24:12.776695 13400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:12.777156 13402 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:12.780393 13402 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:12.786206 13402 catalog_manager.cc:1347] Generated new cluster ID: b00aad4946a647889d4c9f8adc25de81
I20260807 15:24:12.786283 13402 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:12.814931 13402 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:12.815939 13402 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:12.825132 13402 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8: Generated new TSK 0
I20260807 15:24:12.825960 13402 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
Entry for principal kudu/127.15.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab.
I20260807 15:24:12.866015 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:33595
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:12.994935 13427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:12.995257 13427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:12.995354 13427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:12.999524 13427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:12.999637 13427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:12.999735 13427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:24:13.005455 13427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.193.keytab
--principal=kudu/127.15.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:33595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:13.006652 13427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:13.007776 13427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:13.018487 13436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:13.018501 13443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:13.018767 13427 server_base.cc:1034] running on GCE node
W20260807 15:24:13.018950 13435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:13.019397 13427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:13.020203 13427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:13.021380 13427 hybrid_clock.cc:648] HybridClock initialized: now 1786116253021361 us; error 33 us; skew 500 ppm
Aug 07 15:24:13 dist-test-slave-g170 krb5kdc[13272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116253, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:13.024703 13427 init.cc:377] Logged in from keytab as kudu/127.15.242.193@KRBTEST.COM (short username kudu)
I20260807 15:24:13.025774 13427 webserver.cc:460] Webserver started at http://127.15.242.193:42887/ using document root <none> and password file <none>
I20260807 15:24:13.026371 13427 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:13.026434 13427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:13.026666 13427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:13.028844 13427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "b63313c3ef1049a6887f237b6ddab0a7"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "78e1cb413e73ddd010bc29c795349b7c"
server_key_iv: "d07f30194b52301a5cca1ac1af29ffed"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.029445 13427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "b63313c3ef1049a6887f237b6ddab0a7"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "78e1cb413e73ddd010bc29c795349b7c"
server_key_iv: "d07f30194b52301a5cca1ac1af29ffed"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.033457 13427 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 15:24:13.036051 13455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.037587 13427 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:13.037734 13427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "b63313c3ef1049a6887f237b6ddab0a7"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "78e1cb413e73ddd010bc29c795349b7c"
server_key_iv: "d07f30194b52301a5cca1ac1af29ffed"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.037878 13427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:13.060693 13427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:13.064236 13427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:13.064456 13427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:13.065132 13427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:13.066035 13427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:13.066113 13427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.066197 13427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:13.066243 13427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.075275 13427 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:36839
I20260807 15:24:13.075309 13625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:36839 every 8 connection(s)
I20260807 15:24:13.076244 13427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:24:13.085212 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 13427
I20260807 15:24:13.085367 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:24:13.085770 16331 external_mini_cluster.cc:1428] Setting key 52cbe16b1459f7fa3a9603edbf1eb156
Aug 07 15:24:13 dist-test-slave-g170 krb5kdc[13272](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116253, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.193@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:13.091279 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.078490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:52273 (local address 127.15.242.254:33595)
0807 15:24:13.078673 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.078677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.079578 (+ 901us) server_negotiation.cc:407] Connection header received
0807 15:24:13.081011 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.081014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.081061 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.081139 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:13.082365 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.082965 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.084199 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.084427 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.084513 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.087560 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:13.087569 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:13.087571 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:13.087595 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:13.089201 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:13.089727 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:13.089732 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:13.089734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:13.089823 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:13.090184 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:13.090190 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:13.090193 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:13.090375 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:13.090482 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.090980 (+ 498us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.091109 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 15:24:13.092092 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.078938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:33595 (local address 127.15.242.193:52273)
0807 15:24:13.079422 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.079466 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.080809 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.081310 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.081317 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.081723 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:13.082215 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.082229 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.083115 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.083119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.084054 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.084064 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.084567 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.084570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.084716 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.085676 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:13.085699 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:13.087395 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:13.089321 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:13.089328 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:13.089344 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:13.089616 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:13.089936 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:13.089939 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:13.089941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:13.090089 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:13.090482 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:13.090490 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:13.090750 (+ 260us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.090937 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.091278 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":124,"threads_started":1}
I20260807 15:24:13.093425 13626 heartbeater.cc:347] Connected to a master server at 127.15.242.254:33595
I20260807 15:24:13.093724 13626 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:13.094362 13626 heartbeater.cc:511] Master 127.15.242.254:33595 requested a full tablet report, sending...
I20260807 15:24:13.096074 13335 ts_manager.cc:194] Registered new tserver with Master: b63313c3ef1049a6887f237b6ddab0a7 (127.15.242.193:36839)
WARNING: no policy specified for kudu/127.15.242.194@KRBTEST.COM; defaulting to no policy
I20260807 15:24:13.097337 13335 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.193@KRBTEST.COM'} at 127.15.242.193:52273
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
Entry for principal kudu/127.15.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab.
I20260807 15:24:13.115845 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:33595
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:13.238315 13631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:13.238613 13631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:13.238682 13631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:13.242938 13631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:13.243000 13631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:13.243095 13631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:24:13.248739 13631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.194.keytab
--principal=kudu/127.15.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:33595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:13.249858 13631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:13.250914 13631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:13.260848 13650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:13.260890 13648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:13.260933 13631 server_base.cc:1034] running on GCE node
W20260807 15:24:13.260870 13652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:13.261469 13631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:13.262115 13631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:13.263298 13631 hybrid_clock.cc:648] HybridClock initialized: now 1786116253263267 us; error 44 us; skew 500 ppm
Aug 07 15:24:13 dist-test-slave-g170 krb5kdc[13272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116253, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:13.266206 13631 init.cc:377] Logged in from keytab as kudu/127.15.242.194@KRBTEST.COM (short username kudu)
I20260807 15:24:13.267127 13631 webserver.cc:460] Webserver started at http://127.15.242.194:36329/ using document root <none> and password file <none>
I20260807 15:24:13.267724 13631 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:13.267836 13631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:13.268021 13631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:13.270048 13631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "ff259796e5d6456d8f1d76e60e3f3c3d"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "c15d247d0b5341865a11753705b59440"
server_key_iv: "146aa88ae692e3f56264709989d8b938"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.270570 13631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "ff259796e5d6456d8f1d76e60e3f3c3d"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "c15d247d0b5341865a11753705b59440"
server_key_iv: "146aa88ae692e3f56264709989d8b938"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.274366 13631 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:13.277141 13660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.278512 13631 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:13.278642 13631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "ff259796e5d6456d8f1d76e60e3f3c3d"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "c15d247d0b5341865a11753705b59440"
server_key_iv: "146aa88ae692e3f56264709989d8b938"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.278756 13631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:13.305744 13631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:13.309263 13631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:13.309478 13631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:13.310153 13631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:13.311053 13631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:13.311122 13631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.311192 13631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:13.311239 13631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.320487 13631 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:34525
I20260807 15:24:13.320515 13838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:34525 every 8 connection(s)
I20260807 15:24:13.321427 13631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:24:13.323755 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 13631
I20260807 15:24:13.323899 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:24:13.324281 16331 external_mini_cluster.cc:1428] Setting key eb770e5721796bac703b5f1d2f9fbe6a
Aug 07 15:24:13 dist-test-slave-g170 krb5kdc[13272](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116253, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.194@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.195@KRBTEST.COM; defaulting to no policy
I20260807 15:24:13.337630 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.323336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:49019 (local address 127.15.242.254:33595)
0807 15:24:13.323491 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.323496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.324562 (+ 1066us) server_negotiation.cc:407] Connection header received
0807 15:24:13.326357 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.326361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.326415 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.326499 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:13.327954 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.328566 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.330122 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.330390 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.330515 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.333525 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:13.333530 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:13.333533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:13.333569 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:13.335099 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:13.335697 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:13.335701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:13.335703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:13.335802 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:13.336385 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:13.336388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:13.336389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:13.336591 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:13.336710 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.337292 (+ 582us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.337441 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.195@KRBTEST.COM" created.
I20260807 15:24:13.338681 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.323796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:33595 (local address 127.15.242.194:49019)
0807 15:24:13.324412 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.324469 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.326146 (+ 1677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.326680 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.326688 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.327179 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:13.327777 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.327794 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.328721 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.328725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.329952 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.329964 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.330560 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.330564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.330802 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.331448 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:13.331465 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:13.333347 (+ 1882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:13.335268 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:13.335276 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:13.335292 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:13.335576 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:13.335905 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:13.335909 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:13.335912 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:13.336069 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:13.336730 (+ 661us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:13.336738 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:13.337028 (+ 290us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.337225 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.337697 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":154,"threads_started":1}
I20260807 15:24:13.340044 13840 heartbeater.cc:347] Connected to a master server at 127.15.242.254:33595
I20260807 15:24:13.340346 13840 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:13.340942 13840 heartbeater.cc:511] Master 127.15.242.254:33595 requested a full tablet report, sending...
I20260807 15:24:13.342151 13335 ts_manager.cc:194] Registered new tserver with Master: ff259796e5d6456d8f1d76e60e3f3c3d (127.15.242.194:34525)
I20260807 15:24:13.342885 13335 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.194@KRBTEST.COM'} at 127.15.242.194:49019
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
Entry for principal kudu/127.15.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab.
I20260807 15:24:13.355983 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:33595
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:13.473155 13847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:13.473435 13847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:13.473482 13847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:13.477674 13847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:13.477730 13847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:13.477788 13847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:24:13.483363 13847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.195.keytab
--principal=kudu/127.15.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:33595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:13.484377 13847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:13.485385 13847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:13.495136 13856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:13.495196 13854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:13.495203 13853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:13.495536 13847 server_base.cc:1034] running on GCE node
I20260807 15:24:13.495944 13847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:13.496616 13847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:13.497831 13847 hybrid_clock.cc:648] HybridClock initialized: now 1786116253497792 us; error 50 us; skew 500 ppm
Aug 07 15:24:13 dist-test-slave-g170 krb5kdc[13272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116253, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:13.500949 13847 init.cc:377] Logged in from keytab as kudu/127.15.242.195@KRBTEST.COM (short username kudu)
I20260807 15:24:13.501938 13847 webserver.cc:460] Webserver started at http://127.15.242.195:35623/ using document root <none> and password file <none>
I20260807 15:24:13.502556 13847 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:13.502647 13847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:13.502866 13847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:13.505076 13847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "cfac65e9559b4fc2867b306cb788279b"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "efd096c6cd8ab69332518400b5ec398b"
server_key_iv: "e3510ac4dd8e283bb6f420033018e7fe"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.505668 13847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "cfac65e9559b4fc2867b306cb788279b"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "efd096c6cd8ab69332518400b5ec398b"
server_key_iv: "e3510ac4dd8e283bb6f420033018e7fe"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.509730 13847 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:24:13.512451 13873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.513832 13847 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:24:13.513970 13847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "cfac65e9559b4fc2867b306cb788279b"
format_stamp: "Formatted at 2026-08-07 15:24:13 on dist-test-slave-g170"
server_key: "efd096c6cd8ab69332518400b5ec398b"
server_key_iv: "e3510ac4dd8e283bb6f420033018e7fe"
server_key_version: "encryptionkey@0"
I20260807 15:24:13.514082 13847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:13.546984 13847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:13.550608 13847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:13.550836 13847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:13.551543 13847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:13.552479 13847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:13.552553 13847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.552626 13847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:13.552667 13847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:13.562288 13847 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:44431
I20260807 15:24:13.562312 14039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:44431 every 8 connection(s)
I20260807 15:24:13.563246 13847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:24:13.563704 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 13847
I20260807 15:24:13.563871 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:24:13.564240 16331 external_mini_cluster.cc:1428] Setting key c5fabcece7a09cb9187bae2a9fc613a1
Aug 07 15:24:13 dist-test-slave-g170 krb5kdc[13272](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116253, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.195@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:13.578181 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.565413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:44709 (local address 127.15.242.254:33595)
0807 15:24:13.565540 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.565544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.567294 (+ 1750us) server_negotiation.cc:407] Connection header received
0807 15:24:13.568233 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.568237 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.568292 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.568372 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:13.569632 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.570170 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.571315 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.571537 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.571646 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.574135 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:13.574139 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:13.574142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:13.574173 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:13.575664 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:13.576260 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:13.576267 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:13.576268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:13.576355 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:13.576838 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:13.576841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:13.576846 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:13.577029 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:13.577115 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.577817 (+ 702us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.577981 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 15:24:13.579124 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.565850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:33595 (local address 127.15.242.195:44709)
0807 15:24:13.567120 (+ 1270us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.567184 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.568025 (+ 841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.568547 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.568554 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.568976 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:13.569485 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.569498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.570298 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.570301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.571188 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.571197 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.571689 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.571693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.571865 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.572480 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:13.572497 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:13.573970 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:13.575822 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:13.575827 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:13.575840 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:13.576102 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:13.576461 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:13.576465 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:13.576466 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:13.576694 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:13.577157 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:13.577163 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:13.577525 (+ 362us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.577688 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.578094 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"thread_start_us":732,"threads_started":1}
I20260807 15:24:13.580251 14043 heartbeater.cc:347] Connected to a master server at 127.15.242.254:33595
I20260807 15:24:13.580502 14043 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:13.581120 14043 heartbeater.cc:511] Master 127.15.242.254:33595 requested a full tablet report, sending...
I20260807 15:24:13.582231 13335 ts_manager.cc:194] Registered new tserver with Master: cfac65e9559b4fc2867b306cb788279b (127.15.242.195:44431)
I20260807 15:24:13.582834 13335 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.242.195@KRBTEST.COM'} at 127.15.242.195:44709
I20260807 15:24:13.590818 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:24:13.600391 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.592975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45650 (local address 127.15.242.254:33595)
0807 15:24:13.593084 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.593088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.593337 (+ 249us) server_negotiation.cc:407] Connection header received
0807 15:24:13.593503 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.593506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.593544 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.593620 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:13.594332 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.594946 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.595786 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.596000 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.596109 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.597498 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:13.597503 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:13.597506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:13.597534 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:13.598736 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:13.599159 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:13.599163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:13.599165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:13.599249 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:13.599515 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:13.599518 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:13.599520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:13.599731 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:13.599867 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.600102 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.600229 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 15:24:13.603430 13335 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:24:13.606608 13335 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:24:13.621471 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.615369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36839 (local address 127.0.0.1:58460)
0807 15:24:13.615945 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.615962 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.616052 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.616998 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.617004 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.617031 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:13.617170 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.617177 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.618561 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.618566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.619911 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.619923 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.620947 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.620952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.621056 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.621094 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.621208 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.621326 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":110,"threads_started":1}
I20260807 15:24:13.621483 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.616068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58460 (local address 127.15.242.193:36839)
0807 15:24:13.616410 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.616417 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.616443 (+ 26us) server_negotiation.cc:407] Connection header received
0807 15:24:13.616525 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.616532 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.616807 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.617335 (+ 528us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:13.617486 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.618450 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.620049 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.620825 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.621000 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.621144 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.621233 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.621326 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":145,"threads_started":1}
I20260807 15:24:13.621803 14058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.615287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:34525 (local address 127.0.0.1:41582)
0807 15:24:13.615759 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.615808 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.615941 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.617414 (+ 1473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.617417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.617435 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:13.617543 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.617551 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.619113 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.619116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.620246 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.620254 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.621395 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.621399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.621498 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.621521 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.621575 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.621642 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":63,"thread_start_us":66,"threads_started":1}
I20260807 15:24:13.621971 14064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.616088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44431 (local address 127.0.0.1:40384)
0807 15:24:13.616586 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.616599 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.616689 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.617591 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.617594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.617611 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:13.617700 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.617706 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.619169 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.619172 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.620330 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.620341 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.621589 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.621592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.621683 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.621704 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.621779 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.621849 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":1,"thread_start_us":124,"threads_started":1}
I20260807 15:24:13.622256 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.616476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40384 (local address 127.15.242.195:44431)
0807 15:24:13.616971 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.616985 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.617007 (+ 22us) server_negotiation.cc:407] Connection header received
0807 15:24:13.617080 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.617084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.617298 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.617447 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:13.617848 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.618971 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.620439 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.621278 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.621395 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.621527 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.621818 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.621940 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":110,"threads_started":1}
I20260807 15:24:13.623481 14061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.615517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41582 (local address 127.15.242.194:34525)
0807 15:24:13.616917 (+ 1400us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.616934 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.616958 (+ 24us) server_negotiation.cc:407] Connection header received
0807 15:24:13.617039 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.617045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.617276 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.617437 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:13.617668 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.618944 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.620360 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.621243 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.623054 (+ 1811us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.623209 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.623259 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.623346 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":880,"thread_start_us":206,"threads_started":1}
I20260807 15:24:13.625094 13528 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd379bd4a924196abbc8f584fa278c2 (DEFAULT_TABLE table=test-table [id=9259a134f9d443169a8e830a12b7290b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:13.625109 13949 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd379bd4a924196abbc8f584fa278c2 (DEFAULT_TABLE table=test-table [id=9259a134f9d443169a8e830a12b7290b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:13.626030 13528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd379bd4a924196abbc8f584fa278c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:13.626133 13949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd379bd4a924196abbc8f584fa278c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:13.626066 13730 tablet_service.cc:1467] Processing CreateTablet for tablet 3dd379bd4a924196abbc8f584fa278c2 (DEFAULT_TABLE table=test-table [id=9259a134f9d443169a8e830a12b7290b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:13.626993 13730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dd379bd4a924196abbc8f584fa278c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:13.632300 14066 tablet_bootstrap.cc:492] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7: Bootstrap starting.
I20260807 15:24:13.633934 14068 tablet_bootstrap.cc:492] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: Bootstrap starting.
I20260807 15:24:13.634262 14069 tablet_bootstrap.cc:492] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: Bootstrap starting.
I20260807 15:24:13.634737 14066 tablet_bootstrap.cc:654] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:13.635473 14066 log.cc:824] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:13.636065 14068 tablet_bootstrap.cc:654] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:13.636161 14069 tablet_bootstrap.cc:654] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:13.637507 14068 log.cc:824] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:13.637507 14069 log.cc:824] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:13.637777 14066 tablet_bootstrap.cc:492] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7: No bootstrap required, opened a new log
I20260807 15:24:13.637987 14066 ts_tablet_manager.cc:1397] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:24:13.639529 14069 tablet_bootstrap.cc:492] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: No bootstrap required, opened a new log
I20260807 15:24:13.639747 14069 ts_tablet_manager.cc:1397] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:24:13.640631 14068 tablet_bootstrap.cc:492] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: No bootstrap required, opened a new log
I20260807 15:24:13.640897 14068 ts_tablet_manager.cc:1397] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 15:24:13.642463 14066 raft_consensus.cc:348] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.642750 14066 raft_consensus.cc:374] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:13.642818 14066 raft_consensus.cc:729] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63313c3ef1049a6887f237b6ddab0a7, State: Initialized, Role: FOLLOWER
I20260807 15:24:13.643301 14066 consensus_queue.cc:260] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.643996 13626 heartbeater.cc:503] Master 127.15.242.254:33595 was elected leader, sending a full tablet report...
I20260807 15:24:13.644591 14066 ts_tablet_manager.cc:1428] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 15:24:13.644397 14069 raft_consensus.cc:348] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.644671 14069 raft_consensus.cc:374] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:13.644728 14069 raft_consensus.cc:729] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff259796e5d6456d8f1d76e60e3f3c3d, State: Initialized, Role: FOLLOWER
I20260807 15:24:13.645186 14069 consensus_queue.cc:260] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.645005 14068 raft_consensus.cc:348] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.645602 14068 raft_consensus.cc:374] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:13.645695 14068 raft_consensus.cc:729] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfac65e9559b4fc2867b306cb788279b, State: Initialized, Role: FOLLOWER
I20260807 15:24:13.645941 13840 heartbeater.cc:503] Master 127.15.242.254:33595 was elected leader, sending a full tablet report...
I20260807 15:24:13.646154 14069 ts_tablet_manager.cc:1428] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:24:13.646193 14068 consensus_queue.cc:260] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.646951 14043 heartbeater.cc:503] Master 127.15.242.254:33595 was elected leader, sending a full tablet report...
I20260807 15:24:13.647297 14068 ts_tablet_manager.cc:1428] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 15:24:13.700836 14080 raft_consensus.cc:482] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:24:13.701038 14080 raft_consensus.cc:504] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.702234 14080 leader_election.cc:288] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b63313c3ef1049a6887f237b6ddab0a7 (127.15.242.193:36839), cfac65e9559b4fc2867b306cb788279b (127.15.242.195:44431)
I20260807 15:24:13.704254 14081 raft_consensus.cc:482] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:24:13.704447 14081 raft_consensus.cc:504] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.705742 14081 leader_election.cc:288] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff259796e5d6456d8f1d76e60e3f3c3d (127.15.242.194:34525), b63313c3ef1049a6887f237b6ddab0a7 (127.15.242.193:36839)
I20260807 15:24:13.706750 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.702412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36839 (local address 127.15.242.194:57147)
0807 15:24:13.702542 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.702558 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.702659 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.702966 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.702970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.703000 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:13.703119 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.703125 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.703902 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.703905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.705107 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.705119 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.706161 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.706164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.706377 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.706416 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.706486 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.706558 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":55,"spinlock_wait_cycles":4352}
I20260807 15:24:13.706765 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.702728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:54385 (local address 127.15.242.195:44431)
0807 15:24:13.702884 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.702890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.702977 (+ 87us) server_negotiation.cc:407] Connection header received
0807 15:24:13.703133 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.703136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.703183 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.703263 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:13.703544 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.704043 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.705337 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.705903 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.706034 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.706086 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.706546 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.706625 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 15:24:13.707126 14083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.702477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:44431 (local address 127.15.242.194:54385)
0807 15:24:13.702878 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.702888 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.703017 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.703273 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.703276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.703292 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:13.703434 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.703440 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.704149 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.704154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.705182 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.705208 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.706149 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.706153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.706367 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.706416 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.706905 (+ 489us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.706984 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":47,"spinlock_wait_cycles":2176,"thread_start_us":154,"threads_started":1}
I20260807 15:24:13.707217 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.702533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:57147 (local address 127.15.242.193:36839)
0807 15:24:13.702696 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.702701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.702719 (+ 18us) server_negotiation.cc:407] Connection header received
0807 15:24:13.702782 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.702786 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.702841 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.702951 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:13.703239 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.703780 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.705265 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.705760 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.705877 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.705938 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.707019 (+ 1081us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.707104 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 15:24:13.707744 13979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd379bd4a924196abbc8f584fa278c2" candidate_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfac65e9559b4fc2867b306cb788279b" is_pre_election: true
I20260807 15:24:13.707818 13555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd379bd4a924196abbc8f584fa278c2" candidate_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63313c3ef1049a6887f237b6ddab0a7" is_pre_election: true
I20260807 15:24:13.707999 13979 raft_consensus.cc:2454] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff259796e5d6456d8f1d76e60e3f3c3d in term 0.
I20260807 15:24:13.708110 13555 raft_consensus.cc:2454] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff259796e5d6456d8f1d76e60e3f3c3d in term 0.
I20260807 15:24:13.708509 13661 leader_election.cc:302] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfac65e9559b4fc2867b306cb788279b, ff259796e5d6456d8f1d76e60e3f3c3d; no voters:
I20260807 15:24:13.708850 14080 raft_consensus.cc:2781] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:24:13.708943 14080 raft_consensus.cc:482] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:24:13.709015 14080 raft_consensus.cc:3037] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:13.709932 14061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.705989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:49621 (local address 127.15.242.194:34525)
0807 15:24:13.706088 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.706092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.706107 (+ 15us) server_negotiation.cc:407] Connection header received
0807 15:24:13.706257 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.706262 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.706309 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.706382 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:13.706717 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.707350 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.708848 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.709395 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.709496 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.709529 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.709764 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.709832 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 15:24:13.709939 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.705901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:34525 (local address 127.15.242.195:49621)
0807 15:24:13.706046 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.706062 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.706137 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.706482 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.706485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.706505 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:13.706596 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.706602 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.707487 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.707490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.708665 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.708677 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.709525 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.709528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.709631 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.709655 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.709747 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.709822 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 15:24:13.710491 14080 raft_consensus.cc:504] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.710511 13760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd379bd4a924196abbc8f584fa278c2" candidate_uuid: "cfac65e9559b4fc2867b306cb788279b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" is_pre_election: true
I20260807 15:24:13.710860 14080 leader_election.cc:288] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [CANDIDATE]: Term 1 election: Requested vote from peers b63313c3ef1049a6887f237b6ddab0a7 (127.15.242.193:36839), cfac65e9559b4fc2867b306cb788279b (127.15.242.195:44431)
I20260807 15:24:13.710968 13760 raft_consensus.cc:2379] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfac65e9559b4fc2867b306cb788279b in current term 1: Already voted for candidate ff259796e5d6456d8f1d76e60e3f3c3d in this term.
I20260807 15:24:13.711385 13555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd379bd4a924196abbc8f584fa278c2" candidate_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63313c3ef1049a6887f237b6ddab0a7"
I20260807 15:24:13.711498 13555 raft_consensus.cc:3037] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:13.711681 13979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd379bd4a924196abbc8f584fa278c2" candidate_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfac65e9559b4fc2867b306cb788279b"
I20260807 15:24:13.711814 13979 raft_consensus.cc:3037] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:13.712884 13555 raft_consensus.cc:2454] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff259796e5d6456d8f1d76e60e3f3c3d in term 1.
I20260807 15:24:13.712898 13979 raft_consensus.cc:2454] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff259796e5d6456d8f1d76e60e3f3c3d in term 1.
I20260807 15:24:13.713035 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.706622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:57619 (local address 127.15.242.193:36839)
0807 15:24:13.707355 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.707359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.707840 (+ 481us) server_negotiation.cc:407] Connection header received
0807 15:24:13.708280 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.708286 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.708338 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.708389 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:13.709630 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.710373 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.711711 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.712294 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.712387 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.712432 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.712827 (+ 395us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.712915 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":121,"threads_started":1}
I20260807 15:24:13.713047 14084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.706239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36839 (local address 127.15.242.195:57619)
0807 15:24:13.707748 (+ 1509us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.707764 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:13.708033 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:13.708517 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:13.708523 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:13.708545 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:13.708713 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.708723 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.710491 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.710496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.711560 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:13.711572 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.712536 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.712539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:13.712644 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.712677 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 15:24:13.712787 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 15:24:13.712871 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1439,"thread_start_us":124,"threads_started":1}
I20260807 15:24:13.713234 13661 leader_election.cc:302] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfac65e9559b4fc2867b306cb788279b, ff259796e5d6456d8f1d76e60e3f3c3d; no voters:
I20260807 15:24:13.713439 14080 raft_consensus.cc:2781] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:13.713670 14080 raft_consensus.cc:686] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 1 LEADER]: Becoming Leader. State: Replica: ff259796e5d6456d8f1d76e60e3f3c3d, State: Running, Role: LEADER
I20260807 15:24:13.713670 13555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dd379bd4a924196abbc8f584fa278c2" candidate_uuid: "cfac65e9559b4fc2867b306cb788279b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63313c3ef1049a6887f237b6ddab0a7" is_pre_election: true
I20260807 15:24:13.713830 13555 raft_consensus.cc:2379] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfac65e9559b4fc2867b306cb788279b in current term 1: Already voted for candidate ff259796e5d6456d8f1d76e60e3f3c3d in this term.
I20260807 15:24:13.713989 14080 consensus_queue.cc:237] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } }
I20260807 15:24:13.714250 13876 leader_election.cc:302] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfac65e9559b4fc2867b306cb788279b; no voters: b63313c3ef1049a6887f237b6ddab0a7, ff259796e5d6456d8f1d76e60e3f3c3d
I20260807 15:24:13.714521 14081 raft_consensus.cc:2726] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 15:24:13.717332 13335 catalog_manager.cc:5495] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d reported cstate change: term changed from 0 to 1, leader changed from <none> to ff259796e5d6456d8f1d76e60e3f3c3d (127.15.242.194). New cstate: current_term: 1 leader_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff259796e5d6456d8f1d76e60e3f3c3d" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 } health_report { overall_health: UNKNOWN } } }
I20260807 15:24:13.744114 14061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.740365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41596 (local address 127.15.242.194:34525)
0807 15:24:13.740520 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:13.740527 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:13.740544 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:24:13.740639 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:13.740642 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:13.740704 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:13.740869 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:13.741185 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.741697 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.742609 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:13.742839 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:13.742950 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:13.743269 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:13.743728 (+ 459us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:13.743864 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:13.743914 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 15:24:13.743969 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 15:24:13.750227 13555 raft_consensus.cc:1261] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 1 FOLLOWER]: Refusing update from remote peer ff259796e5d6456d8f1d76e60e3f3c3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:13.750473 13979 raft_consensus.cc:1261] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 1 FOLLOWER]: Refusing update from remote peer ff259796e5d6456d8f1d76e60e3f3c3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:13.750939 14092 consensus_queue.cc:1035] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63313c3ef1049a6887f237b6ddab0a7" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 36839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:13.751258 14080 consensus_queue.cc:1035] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfac65e9559b4fc2867b306cb788279b" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 44431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:13.762296 14097 mvcc.cc:205] Tried to move back new op lower bound from 7315932175352926208 to 7315932175215415296. Current Snapshot: MvccSnapshot[applied={T|T < 7315932175352926208 or (T in {7315932175352926208})}]
I20260807 15:24:13.767882 14096 mvcc.cc:205] Tried to move back new op lower bound from 7315932175352926208 to 7315932175215415296. Current Snapshot: MvccSnapshot[applied={T|T < 7315932175352926208}]
I20260807 15:24:13.769897 13334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:13.770049 13334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:13.772226 13334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 665bfce3312447c8b2d4b56d2c18e7a8: Sending DeleteTablet for 3 replicas of tablet 3dd379bd4a924196abbc8f584fa278c2
I20260807 15:24:13.773037 13528 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dd379bd4a924196abbc8f584fa278c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:13 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:58460
I20260807 15:24:13.773030 13730 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dd379bd4a924196abbc8f584fa278c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:13 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:41582
I20260807 15:24:13.773572 14112 tablet_replica.cc:330] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7: stopping tablet replica
I20260807 15:24:13.773944 13949 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dd379bd4a924196abbc8f584fa278c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:13 UTC) from {username='kudu', principal='kudu/127.15.242.254@KRBTEST.COM'} at 127.0.0.1:40384
I20260807 15:24:13.774008 14112 raft_consensus.cc:2229] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:24:13.774367 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 13427
I20260807 15:24:13.774494 14112 raft_consensus.cc:2258] T 3dd379bd4a924196abbc8f584fa278c2 P b63313c3ef1049a6887f237b6ddab0a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:13.774923 14114 tablet_replica.cc:330] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: stopping tablet replica
I20260807 15:24:13.775246 14114 raft_consensus.cc:2229] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:24:13.775594 14114 raft_consensus.cc:2258] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:13.777191 14115 tablet_replica.cc:330] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: stopping tablet replica
I20260807 15:24:13.778344 14114 ts_tablet_manager.cc:1905] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:13.782325 14115 raft_consensus.cc:2229] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:24:13.782824 14115 raft_consensus.cc:2258] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:13.783406 14114 ts_tablet_manager.cc:1918] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:13.783568 14114 log.cc:1196] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/3dd379bd4a924196abbc8f584fa278c2
I20260807 15:24:13.785378 14115 ts_tablet_manager.cc:1905] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:13.785697 14114 ts_tablet_manager.cc:1939] T 3dd379bd4a924196abbc8f584fa278c2 P ff259796e5d6456d8f1d76e60e3f3c3d: Deleting consensus metadata
I20260807 15:24:13.787243 13317 catalog_manager.cc:4841] TS ff259796e5d6456d8f1d76e60e3f3c3d (127.15.242.194:34525): tablet 3dd379bd4a924196abbc8f584fa278c2 (table test-table [id=9259a134f9d443169a8e830a12b7290b]) successfully deleted
I20260807 15:24:13.790146 14115 ts_tablet_manager.cc:1918] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:13.790261 14115 log.cc:1196] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/3dd379bd4a924196abbc8f584fa278c2
I20260807 15:24:13.791021 14115 ts_tablet_manager.cc:1939] T 3dd379bd4a924196abbc8f584fa278c2 P cfac65e9559b4fc2867b306cb788279b: Deleting consensus metadata
I20260807 15:24:13.792387 13312 catalog_manager.cc:4841] TS cfac65e9559b4fc2867b306cb788279b (127.15.242.195:44431): tablet 3dd379bd4a924196abbc8f584fa278c2 (table test-table [id=9259a134f9d443169a8e830a12b7290b]) successfully deleted
W20260807 15:24:13.794958 13313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:36839 (error 108)
I20260807 15:24:13.795881 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 13631
I20260807 15:24:13.796136 14064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:13.795780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:36839 (local address 127.0.0.1:58474)
0807 15:24:13.795942 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:13.796028 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:36839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 15:24:13.815817 13313 catalog_manager.cc:4584] TS b63313c3ef1049a6887f237b6ddab0a7 (127.15.242.193:36839): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3dd379bd4a924196abbc8f584fa278c2: Network error: Client connection negotiation failed: client connection to 127.15.242.193:36839: connect: Connection refused (error 111)
I20260807 15:24:13.823140 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 13847
I20260807 15:24:13.836686 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 13292
2026-08-07T15:24:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2747 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T15:24:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:13Z Disabled control of system clock
I20260807 15:24:13.878712 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:34301
--webserver_interface=127.15.242.254
--webserver_port=0
--builtin_ntp_servers=127.15.242.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:34301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 15:24:13.997968 14122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:13.998242 14122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:13.998279 14122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:14.002305 14122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:14.002395 14122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:14.002411 14122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:14.002429 14122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:14.002444 14122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:14.007287 14122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:34301
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:34301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:14.008379 14122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:14.009847 14122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:14.018857 14132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:14.018954 14122 server_base.cc:1034] running on GCE node
W20260807 15:24:14.019024 14129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:14.019057 14130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:14.019905 14122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:14.021152 14122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:14.022379 14122 hybrid_clock.cc:648] HybridClock initialized: now 1786116254022344 us; error 48 us; skew 500 ppm
I20260807 15:24:14.024978 14122 webserver.cc:460] Webserver started at http://127.15.242.254:38007/ using document root <none> and password file <none>
I20260807 15:24:14.025684 14122 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:14.025790 14122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:14.026067 14122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:14.028497 14122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "75f29215b49f4aef90f2ecaf73a5da33"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "7cfec473a4cd01809a6e9002308ef9d7"
server_key_iv: "343af5042e580578e88f1b211a8553ad"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.029199 14122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "75f29215b49f4aef90f2ecaf73a5da33"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "7cfec473a4cd01809a6e9002308ef9d7"
server_key_iv: "343af5042e580578e88f1b211a8553ad"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.033504 14122 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:24:14.036300 14144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.037762 14122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:14.037942 14122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "75f29215b49f4aef90f2ecaf73a5da33"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "7cfec473a4cd01809a6e9002308ef9d7"
server_key_iv: "343af5042e580578e88f1b211a8553ad"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.038077 14122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:14.061874 14122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:14.062639 14122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:14.062855 14122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:14.071029 14122 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:34301
I20260807 15:24:14.071041 14217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:34301 every 8 connection(s)
I20260807 15:24:14.072069 14122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:14.075347 14219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:14.075798 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 14122
I20260807 15:24:14.075958 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:14.076300 16331 external_mini_cluster.cc:1428] Setting key 56d4ee598ee72baab044ba281aa4d3fd
I20260807 15:24:14.081322 14219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33: Bootstrap starting.
I20260807 15:24:14.083521 14219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:14.084388 14219 log.cc:824] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:14.086649 14219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33: No bootstrap required, opened a new log
I20260807 15:24:14.086730 14225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.077821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.15.242.254:34301)
0807 15:24:14.078600 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:14.078624 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:14.078678 (+ 54us) server_negotiation.cc:407] Connection header received
0807 15:24:14.079465 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:14.079485 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:14.079913 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:14.080287 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:14.080865 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.081976 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.082970 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.083494 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.083684 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.084724 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:14.084733 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:14.084754 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:14.085217 (+ 463us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:14.085290 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:14.085319 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:14.085425 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:14.085575 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 15:24:14.085839 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":157,"threads_started":1}
I20260807 15:24:14.090543 14219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75f29215b49f4aef90f2ecaf73a5da33" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34301 } }
I20260807 15:24:14.090749 14219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:14.090785 14219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75f29215b49f4aef90f2ecaf73a5da33, State: Initialized, Role: FOLLOWER
I20260807 15:24:14.091148 14219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75f29215b49f4aef90f2ecaf73a5da33" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34301 } }
I20260807 15:24:14.091260 14219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:14.091305 14219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:14.091374 14219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:14.092185 14219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75f29215b49f4aef90f2ecaf73a5da33" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34301 } }
I20260807 15:24:14.092474 14219 leader_election.cc:302] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75f29215b49f4aef90f2ecaf73a5da33; no voters:
I20260807 15:24:14.092731 14219 leader_election.cc:288] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:14.092897 14227 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:14.093195 14227 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [term 1 LEADER]: Becoming Leader. State: Replica: 75f29215b49f4aef90f2ecaf73a5da33, State: Running, Role: LEADER
I20260807 15:24:14.093526 14227 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75f29215b49f4aef90f2ecaf73a5da33" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34301 } }
I20260807 15:24:14.093971 14219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:14.095280 14229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75f29215b49f4aef90f2ecaf73a5da33. Latest consensus state: current_term: 1 leader_uuid: "75f29215b49f4aef90f2ecaf73a5da33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75f29215b49f4aef90f2ecaf73a5da33" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34301 } } }
I20260807 15:24:14.095420 14229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:14.095883 14228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75f29215b49f4aef90f2ecaf73a5da33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75f29215b49f4aef90f2ecaf73a5da33" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 34301 } } }
I20260807 15:24:14.096668 14228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33 [sys.catalog]: This master's current role is: LEADER
W20260807 15:24:14.098935 14244 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:14.099035 14244 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:14.099129 14238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:14.099978 14238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:14.106400 14238 catalog_manager.cc:1347] Generated new cluster ID: 45f8ef09983c4f91acaea3f9ab5f786f
I20260807 15:24:14.106493 14238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:14.120354 14238 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:14.121377 14238 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:14.132030 14238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33: Generated new TSK 0
I20260807 15:24:14.132948 14238 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:14.145112 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.193:0
--local_ip_for_outbound_sockets=127.15.242.193
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34301
--builtin_ntp_servers=127.15.242.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 15:24:14.273180 14249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:14.273584 14249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:14.273707 14249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:14.278983 14249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:14.279049 14249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:14.279109 14249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.193
I20260807 15:24:14.284016 14249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.242.193
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.193
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:14.285189 14249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:14.286569 14249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:14.296823 14261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:14.296814 14263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:14.296875 14267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:14.297148 14249 server_base.cc:1034] running on GCE node
I20260807 15:24:14.297521 14249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:14.298162 14249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:14.299340 14249 hybrid_clock.cc:648] HybridClock initialized: now 1786116254299321 us; error 29 us; skew 500 ppm
I20260807 15:24:14.301494 14249 webserver.cc:460] Webserver started at http://127.15.242.193:36941/ using document root <none> and password file <none>
I20260807 15:24:14.302098 14249 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:14.302165 14249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:14.302379 14249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:14.304527 14249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/data/instance:
uuid: "289ea24fa4e74117922751c05b6618e4"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "310d293e475b667e7c940197eae836fa"
server_key_iv: "5fb40030827c0c5a0f55a28c613e7671"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.305154 14249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance:
uuid: "289ea24fa4e74117922751c05b6618e4"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "310d293e475b667e7c940197eae836fa"
server_key_iv: "5fb40030827c0c5a0f55a28c613e7671"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.309039 14249 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:24:14.311591 14275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.312963 14249 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:24:14.313094 14249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/wal
uuid: "289ea24fa4e74117922751c05b6618e4"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "310d293e475b667e7c940197eae836fa"
server_key_iv: "5fb40030827c0c5a0f55a28c613e7671"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.313208 14249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:14.334646 14249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:14.335397 14249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:14.335602 14249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:14.336249 14249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:14.337316 14249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:14.337385 14249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.337459 14249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:14.337502 14249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.347489 14249 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.193:38847
I20260807 15:24:14.347532 14478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.193:38847 every 8 connection(s)
I20260807 15:24:14.348501 14249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/data/info.pb
I20260807 15:24:14.353595 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 14249
I20260807 15:24:14.353737 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-0/wal/instance
I20260807 15:24:14.354069 16331 external_mini_cluster.cc:1428] Setting key 1b2703146d714c5456be2bbdc0c21cd0
I20260807 15:24:14.356379 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.194:0
--local_ip_for_outbound_sockets=127.15.242.194
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34301
--builtin_ntp_servers=127.15.242.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 15:24:14.359998 14225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.350631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.193:56451 (local address 127.15.242.254:34301)
0807 15:24:14.350780 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:14.350784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:14.351967 (+ 1183us) server_negotiation.cc:407] Connection header received
0807 15:24:14.353453 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:14.353457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:14.353511 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:14.353595 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:14.354849 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.355728 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.357515 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.357813 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.357983 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.359395 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:14.359401 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:14.359405 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:14.359423 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:14.359451 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:14.359464 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:14.359560 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:14.359701 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 15:24:14.359784 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 15:24:14.360914 14483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.351105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34301 (local address 127.15.242.193:56451)
0807 15:24:14.351809 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:14.351851 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:14.353205 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:14.353828 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:14.353838 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:14.353958 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:14.354639 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.354668 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.355872 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.355875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.357371 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.357386 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.358041 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.358047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.358292 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.359112 (+ 820us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:14.359113 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:14.359155 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:14.359223 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:14.359557 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:14.359564 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:14.359569 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 15:24:14.359674 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 15:24:14.359901 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":121,"threads_started":1}
I20260807 15:24:14.362243 14480 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34301
I20260807 15:24:14.362499 14480 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:14.363121 14480 heartbeater.cc:511] Master 127.15.242.254:34301 requested a full tablet report, sending...
I20260807 15:24:14.364715 14167 ts_manager.cc:194] Registered new tserver with Master: 289ea24fa4e74117922751c05b6618e4 (127.15.242.193:38847)
I20260807 15:24:14.366036 14167 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.193:56451
W20260807 15:24:14.477427 14484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:14.477876 14484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:14.478003 14484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:14.482206 14484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:14.482292 14484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:14.482388 14484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.194
I20260807 15:24:14.487416 14484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.242.194
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.194
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:14.488605 14484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:14.490092 14484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:14.500819 14502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:14.500851 14496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:14.500900 14484 server_base.cc:1034] running on GCE node
W20260807 15:24:14.501077 14504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:14.501468 14484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:14.502171 14484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:14.503376 14484 hybrid_clock.cc:648] HybridClock initialized: now 1786116254503365 us; error 40 us; skew 500 ppm
I20260807 15:24:14.505471 14484 webserver.cc:460] Webserver started at http://127.15.242.194:34893/ using document root <none> and password file <none>
I20260807 15:24:14.506093 14484 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:14.506187 14484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:14.506428 14484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:14.508636 14484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/data/instance:
uuid: "e046926a56fa45b1906f95ef4fde268f"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "9948095e7167d40e70ab81313aed571f"
server_key_iv: "4cc91b947296f2be5d035c3c142b56de"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.509305 14484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance:
uuid: "e046926a56fa45b1906f95ef4fde268f"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "9948095e7167d40e70ab81313aed571f"
server_key_iv: "4cc91b947296f2be5d035c3c142b56de"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.513810 14484 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:24:14.516913 14510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.518399 14484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:24:14.518549 14484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/wal
uuid: "e046926a56fa45b1906f95ef4fde268f"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "9948095e7167d40e70ab81313aed571f"
server_key_iv: "4cc91b947296f2be5d035c3c142b56de"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.518687 14484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:14.529515 14484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:14.530344 14484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:14.530557 14484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:14.531206 14484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:14.532253 14484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:14.532323 14484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.532395 14484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:14.532441 14484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.542212 14484 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.194:41389
I20260807 15:24:14.542392 14687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.194:41389 every 8 connection(s)
I20260807 15:24:14.543287 14484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/data/info.pb
I20260807 15:24:14.545656 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 14484
I20260807 15:24:14.545835 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/wal/instance
I20260807 15:24:14.546159 16331 external_mini_cluster.cc:1428] Setting key b36223745b4dfe245a81ab1b10c77d35
I20260807 15:24:14.548699 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.242.195:0
--local_ip_for_outbound_sockets=127.15.242.195
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34301
--builtin_ntp_servers=127.15.242.212:33001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 15:24:14.554782 14225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.545418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.194:50975 (local address 127.15.242.254:34301)
0807 15:24:14.545617 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:14.545624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:14.546847 (+ 1223us) server_negotiation.cc:407] Connection header received
0807 15:24:14.548670 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:14.548674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:14.548735 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:14.548851 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:14.549824 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.550371 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.552294 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.552685 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.552867 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.554105 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:14.554112 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:14.554115 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:14.554139 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:14.554170 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:14.554185 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:14.554282 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:14.554462 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 15:24:14.554551 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 15:24:14.555549 14691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.545837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34301 (local address 127.15.242.194:50975)
0807 15:24:14.546675 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:14.546734 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:14.548430 (+ 1696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:14.549050 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:14.549058 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:14.549147 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:14.549664 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.549678 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.550516 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.550523 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.552123 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.552140 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.552912 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.552915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.553079 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.553754 (+ 675us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:14.553755 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:14.553834 (+ 79us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:14.553912 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:14.554284 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:14.554296 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:14.554308 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 15:24:14.554418 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 15:24:14.554658 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":155,"threads_started":1}
I20260807 15:24:14.556910 14688 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34301
I20260807 15:24:14.557220 14688 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:14.557963 14688 heartbeater.cc:511] Master 127.15.242.254:34301 requested a full tablet report, sending...
I20260807 15:24:14.559306 14167 ts_manager.cc:194] Registered new tserver with Master: e046926a56fa45b1906f95ef4fde268f (127.15.242.194:41389)
I20260807 15:24:14.559893 14167 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.194:50975
W20260807 15:24:14.670383 14692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:14.670667 14692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:14.670717 14692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:14.674849 14692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:14.674907 14692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:14.674999 14692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.242.195
I20260807 15:24:14.679832 14692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:33001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.242.195
--webserver_port=0
--tserver_master_addrs=127.15.242.254:34301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.242.195
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:14.681003 14692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:14.682435 14692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:14.692420 14698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:14.692459 14699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:14.692459 14701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:14.692634 14692 server_base.cc:1034] running on GCE node
I20260807 15:24:14.693084 14692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:14.693753 14692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:14.694929 14692 hybrid_clock.cc:648] HybridClock initialized: now 1786116254694903 us; error 36 us; skew 500 ppm
I20260807 15:24:14.697029 14692 webserver.cc:460] Webserver started at http://127.15.242.195:39487/ using document root <none> and password file <none>
I20260807 15:24:14.697610 14692 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:14.697674 14692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:14.697847 14692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:14.700009 14692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/data/instance:
uuid: "6e4c4dfb476946c2a688c9b0923c61ca"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "35f180231a13967e90a7a0dab2c2ab8b"
server_key_iv: "5aae50849927de174387b074ab9be11b"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.700569 14692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance:
uuid: "6e4c4dfb476946c2a688c9b0923c61ca"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "35f180231a13967e90a7a0dab2c2ab8b"
server_key_iv: "5aae50849927de174387b074ab9be11b"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.704468 14692 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260807 15:24:14.707137 14713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.708495 14692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:24:14.708599 14692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/wal
uuid: "6e4c4dfb476946c2a688c9b0923c61ca"
format_stamp: "Formatted at 2026-08-07 15:24:14 on dist-test-slave-g170"
server_key: "35f180231a13967e90a7a0dab2c2ab8b"
server_key_iv: "5aae50849927de174387b074ab9be11b"
server_key_version: "encryptionkey@0"
I20260807 15:24:14.708690 14692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:14.742542 14692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:14.743378 14692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:14.743557 14692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:14.744170 14692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 15:24:14.745232 14692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 15:24:14.745294 14692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.745343 14692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 15:24:14.745360 14692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:14.755327 14692 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.195:46541
I20260807 15:24:14.755354 14907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.195:46541 every 8 connection(s)
I20260807 15:24:14.756372 14692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/data/info.pb
I20260807 15:24:14.757755 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 14692
I20260807 15:24:14.757884 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/wal/instance
I20260807 15:24:14.758291 16331 external_mini_cluster.cc:1428] Setting key 1fdbaa093039bc54ba8d8af098e881a1
I20260807 15:24:14.766559 14225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.758601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:58017 (local address 127.15.242.254:34301)
0807 15:24:14.758766 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:14.758771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:14.760175 (+ 1404us) server_negotiation.cc:407] Connection header received
0807 15:24:14.761744 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:14.761748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:14.761814 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:14.761896 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:14.762825 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.763363 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.764517 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.764750 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.764890 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.766013 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:14.766016 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:14.766028 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:14.766042 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:14.766067 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:14.766075 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:14.766151 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:14.766345 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 15:24:14.766410 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 15:24:14.767551 14910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.759166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:34301 (local address 127.15.242.195:58017)
0807 15:24:14.760028 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:14.760073 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:14.761530 (+ 1457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:14.762074 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:14.762081 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:14.762170 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:14.762683 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.762695 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.763500 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.763503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.764391 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.764401 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.764937 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.764941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.765108 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.765736 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 15:24:14.765738 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:14.765783 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 15:24:14.765859 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:14.766154 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:14.766167 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:14.766174 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 15:24:14.766345 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 15:24:14.766649 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":161,"threads_started":1}
I20260807 15:24:14.768872 14908 heartbeater.cc:347] Connected to a master server at 127.15.242.254:34301
I20260807 15:24:14.769102 14908 heartbeater.cc:464] Registering TS with master...
I20260807 15:24:14.769627 14908 heartbeater.cc:511] Master 127.15.242.254:34301 requested a full tablet report, sending...
I20260807 15:24:14.770710 14167 ts_manager.cc:194] Registered new tserver with Master: 6e4c4dfb476946c2a688c9b0923c61ca (127.15.242.195:46541)
I20260807 15:24:14.771310 14167 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.242.195:58017
I20260807 15:24:14.772850 16331 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 15:24:14.779237 14225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.774996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38910 (local address 127.15.242.254:34301)
0807 15:24:14.775130 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:14.775137 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:14.775378 (+ 241us) server_negotiation.cc:407] Connection header received
0807 15:24:14.775538 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:14.775543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:14.775595 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:14.775686 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:14.776000 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.776511 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.777435 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.777666 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.777783 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.778743 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:14.778748 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:14.778750 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:14.778763 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:14.778783 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:14.778792 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:14.778874 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:14.778996 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 15:24:14.779057 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 15:24:14.782817 14162 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 15:24:14.786232 14162 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 15:24:14.802405 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.795776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49498 (local address 127.15.242.194:41389)
0807 15:24:14.796568 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:14.796581 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:14.797053 (+ 472us) server_negotiation.cc:407] Connection header received
0807 15:24:14.797608 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:14.797614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:14.797829 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:14.798017 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:14.798646 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.799729 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.801065 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.801654 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.801802 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.802008 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:14.802116 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 15:24:14.802221 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":157,"threads_started":1}
I20260807 15:24:14.802402 14925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.795714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:41389 (local address 127.0.0.1:49498)
0807 15:24:14.796911 (+ 1197us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:14.796961 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:14.797451 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:14.798189 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:14.798193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:14.798223 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:14.798495 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.798504 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.799853 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.799858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.800872 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.800883 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.801800 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.801804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.801921 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.801963 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 15:24:14.802090 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 15:24:14.802221 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":951,"mutex_wait_us":82,"spinlock_wait_cycles":5632,"thread_start_us":84,"threads_started":1}
I20260807 15:24:14.803179 14929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.795806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.195:46541 (local address 127.0.0.1:54464)
0807 15:24:14.797141 (+ 1335us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:14.797154 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:14.797306 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:14.797912 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:14.797924 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:14.797948 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:14.798095 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.798108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.799481 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.799485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.800953 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.800967 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.802245 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.802248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.802335 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.802360 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 15:24:14.802432 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 15:24:14.803029 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1245,"spinlock_wait_cycles":2816,"thread_start_us":128,"threads_started":1}
I20260807 15:24:14.803774 14927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.795983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54464 (local address 127.15.242.195:46541)
0807 15:24:14.796690 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:14.796708 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:14.797454 (+ 746us) server_negotiation.cc:407] Connection header received
0807 15:24:14.797549 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:14.797554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:14.797737 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:14.797925 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:14.798217 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.799321 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.801095 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.801886 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.802003 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.802183 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:14.803468 (+ 1285us) server_negotiation.cc:299] Negotiation successful
0807 15:24:14.803577 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":180,"threads_started":1}
I20260807 15:24:14.803956 14924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.796605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38847 (local address 127.0.0.1:59758)
0807 15:24:14.797171 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:14.797186 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:14.797306 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:14.798189 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:14.798193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:14.798223 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:14.798499 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.798505 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.800980 (+ 2475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.800984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.802069 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:14.802079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.803518 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.803521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:14.803622 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.803646 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 15:24:14.803731 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 15:24:14.803809 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":91,"spinlock_wait_cycles":15488,"thread_start_us":111,"threads_started":1}
I20260807 15:24:14.804239 14930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:14.797002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59758 (local address 127.15.242.193:38847)
0807 15:24:14.797501 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:14.797516 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:14.797543 (+ 27us) server_negotiation.cc:407] Connection header received
0807 15:24:14.797615 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:14.797619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:14.797829 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:14.798017 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:14.799645 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.800861 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.802225 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:14.803148 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:14.803281 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:14.803453 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:14.803787 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 15:24:14.803889 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":143,"threads_started":1}
I20260807 15:24:14.805915 14585 tablet_service.cc:1467] Processing CreateTablet for tablet 119363c7ee8240eb9dc98f7ce7743975 (DEFAULT_TABLE table=test-table [id=d1574fb334cc458180f7198d1a850446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:14.807173 14585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119363c7ee8240eb9dc98f7ce7743975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:14.806994 14801 tablet_service.cc:1467] Processing CreateTablet for tablet 119363c7ee8240eb9dc98f7ce7743975 (DEFAULT_TABLE table=test-table [id=d1574fb334cc458180f7198d1a850446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:14.808127 14801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119363c7ee8240eb9dc98f7ce7743975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:14.808928 14363 tablet_service.cc:1467] Processing CreateTablet for tablet 119363c7ee8240eb9dc98f7ce7743975 (DEFAULT_TABLE table=test-table [id=d1574fb334cc458180f7198d1a850446]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 15:24:14.809736 14363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119363c7ee8240eb9dc98f7ce7743975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:14.815662 14931 tablet_bootstrap.cc:492] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Bootstrap starting.
I20260807 15:24:14.816582 14936 tablet_bootstrap.cc:492] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4: Bootstrap starting.
I20260807 15:24:14.817117 14933 tablet_bootstrap.cc:492] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Bootstrap starting.
I20260807 15:24:14.818743 14936 tablet_bootstrap.cc:654] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:14.818856 14931 tablet_bootstrap.cc:654] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:14.819344 14933 tablet_bootstrap.cc:654] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:14.819717 14931 log.cc:824] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:14.819717 14936 log.cc:824] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:14.820174 14933 log.cc:824] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:14.821995 14931 tablet_bootstrap.cc:492] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: No bootstrap required, opened a new log
I20260807 15:24:14.821995 14936 tablet_bootstrap.cc:492] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4: No bootstrap required, opened a new log
I20260807 15:24:14.822204 14933 tablet_bootstrap.cc:492] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: No bootstrap required, opened a new log
I20260807 15:24:14.822209 14936 ts_tablet_manager.cc:1397] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 15:24:14.822209 14931 ts_tablet_manager.cc:1397] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 15:24:14.822408 14933 ts_tablet_manager.cc:1397] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 15:24:14.826507 14933 raft_consensus.cc:348] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:14.826774 14933 raft_consensus.cc:374] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:14.826834 14933 raft_consensus.cc:729] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4c4dfb476946c2a688c9b0923c61ca, State: Initialized, Role: FOLLOWER
I20260807 15:24:14.826717 14936 raft_consensus.cc:348] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:14.826717 14931 raft_consensus.cc:348] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:14.826980 14936 raft_consensus.cc:374] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:14.826980 14931 raft_consensus.cc:374] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:14.827041 14931 raft_consensus.cc:729] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e046926a56fa45b1906f95ef4fde268f, State: Initialized, Role: FOLLOWER
I20260807 15:24:14.827041 14936 raft_consensus.cc:729] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 289ea24fa4e74117922751c05b6618e4, State: Initialized, Role: FOLLOWER
I20260807 15:24:14.827409 14933 consensus_queue.cc:260] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:14.827497 14936 consensus_queue.cc:260] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:14.827497 14931 consensus_queue.cc:260] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:14.828227 14908 heartbeater.cc:503] Master 127.15.242.254:34301 was elected leader, sending a full tablet report...
I20260807 15:24:14.828534 14933 ts_tablet_manager.cc:1428] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:24:14.828547 14936 ts_tablet_manager.cc:1428] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 15:24:14.828931 14480 heartbeater.cc:503] Master 127.15.242.254:34301 was elected leader, sending a full tablet report...
I20260807 15:24:14.829792 14931 ts_tablet_manager.cc:1428] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 15:24:14.830157 14688 heartbeater.cc:503] Master 127.15.242.254:34301 was elected leader, sending a full tablet report...
W20260807 15:24:14.849838 14481 tablet.cc:2369] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:24:15.007544 14909 tablet.cc:2369] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 15:24:15.044605 14689 tablet.cc:2369] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 15:24:15.201498 14941 raft_consensus.cc:482] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 15:24:15.201778 14941 raft_consensus.cc:504] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:15.203122 14941 leader_election.cc:288] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e046926a56fa45b1906f95ef4fde268f (127.15.242.194:41389), 289ea24fa4e74117922751c05b6618e4 (127.15.242.193:38847)
I20260807 15:24:15.207403 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:15.203582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:58129 (local address 127.15.242.194:41389)
0807 15:24:15.203744 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:15.203752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:15.204172 (+ 420us) server_negotiation.cc:407] Connection header received
0807 15:24:15.204349 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:15.204352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:15.204400 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:15.204492 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:15.204820 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.205313 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.206361 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.206762 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.206911 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:15.206968 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:15.207166 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 15:24:15.207242 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 15:24:15.207428 14930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:15.203675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.242.195:53511 (local address 127.15.242.193:38847)
0807 15:24:15.203828 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:15.203833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:15.203853 (+ 20us) server_negotiation.cc:407] Connection header received
0807 15:24:15.204017 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:15.204020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:15.204079 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:15.204174 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 15:24:15.204528 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.205130 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.206244 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.206772 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.206917 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:15.206975 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:15.207194 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 15:24:15.207275 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:24:15.207433 14910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:15.203450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38847 (local address 127.15.242.195:53511)
0807 15:24:15.203696 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:15.203715 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:15.203846 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:15.204202 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:15.204205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:15.204225 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:15.204375 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:15.204383 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.205256 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.205262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:15.206099 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:15.206109 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.206912 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.206917 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:15.207055 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:15.207076 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 15:24:15.207174 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 15:24:15.207264 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":6}
I20260807 15:24:15.207448 14949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:15.203450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.194:41389 (local address 127.15.242.195:58129)
0807 15:24:15.204056 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:15.204069 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:15.204214 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:15.204505 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:15.204508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:15.204524 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 15:24:15.204665 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:15.204671 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.205437 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.205442 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:15.206223 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:15.206233 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.206907 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.206911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:15.207021 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:15.207051 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 15:24:15.207144 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 15:24:15.207237 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":150,"thread_start_us":177,"threads_started":1}
I20260807 15:24:15.208281 14408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119363c7ee8240eb9dc98f7ce7743975" candidate_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "289ea24fa4e74117922751c05b6618e4" is_pre_election: true
I20260807 15:24:15.208283 14617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119363c7ee8240eb9dc98f7ce7743975" candidate_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e046926a56fa45b1906f95ef4fde268f" is_pre_election: true
I20260807 15:24:15.208626 14408 raft_consensus.cc:2454] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4c4dfb476946c2a688c9b0923c61ca in term 0.
I20260807 15:24:15.208635 14617 raft_consensus.cc:2454] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4c4dfb476946c2a688c9b0923c61ca in term 0.
I20260807 15:24:15.209249 14719 leader_election.cc:302] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4c4dfb476946c2a688c9b0923c61ca, e046926a56fa45b1906f95ef4fde268f; no voters:
I20260807 15:24:15.209595 14941 raft_consensus.cc:2781] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 15:24:15.209697 14941 raft_consensus.cc:482] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 15:24:15.209755 14941 raft_consensus.cc:3037] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:15.210930 14941 raft_consensus.cc:504] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:15.211374 14941 leader_election.cc:288] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [CANDIDATE]: Term 1 election: Requested vote from peers e046926a56fa45b1906f95ef4fde268f (127.15.242.194:41389), 289ea24fa4e74117922751c05b6618e4 (127.15.242.193:38847)
I20260807 15:24:15.211841 14408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119363c7ee8240eb9dc98f7ce7743975" candidate_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "289ea24fa4e74117922751c05b6618e4"
I20260807 15:24:15.211856 14617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119363c7ee8240eb9dc98f7ce7743975" candidate_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e046926a56fa45b1906f95ef4fde268f"
I20260807 15:24:15.211992 14408 raft_consensus.cc:3037] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:15.212009 14617 raft_consensus.cc:3037] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:15.213320 14617 raft_consensus.cc:2454] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4c4dfb476946c2a688c9b0923c61ca in term 1.
I20260807 15:24:15.213444 14408 raft_consensus.cc:2454] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4c4dfb476946c2a688c9b0923c61ca in term 1.
I20260807 15:24:15.213721 14719 leader_election.cc:302] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4c4dfb476946c2a688c9b0923c61ca, e046926a56fa45b1906f95ef4fde268f; no voters:
I20260807 15:24:15.213946 14941 raft_consensus.cc:2781] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:15.214171 14941 raft_consensus.cc:686] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 1 LEADER]: Becoming Leader. State: Replica: 6e4c4dfb476946c2a688c9b0923c61ca, State: Running, Role: LEADER
I20260807 15:24:15.214555 14941 consensus_queue.cc:237] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } }
I20260807 15:24:15.218406 14167 catalog_manager.cc:5495] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4c4dfb476946c2a688c9b0923c61ca (127.15.242.195). New cstate: current_term: 1 leader_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4c4dfb476946c2a688c9b0923c61ca" member_type: VOTER last_known_addr { host: "127.15.242.195" port: 46541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 } health_report { overall_health: UNKNOWN } } }
I20260807 15:24:15.256637 14927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:15.252915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54470 (local address 127.15.242.195:46541)
0807 15:24:15.253067 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:15.253071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:15.253151 (+ 80us) server_negotiation.cc:407] Connection header received
0807 15:24:15.253276 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:15.253278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:15.253337 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:15.253441 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:15.253670 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.254201 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.255254 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:15.255468 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:15.255552 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:15.255874 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:15.256296 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:15.256390 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:15.256454 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 15:24:15.256501 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 15:24:15.262984 14617 raft_consensus.cc:1261] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 1 FOLLOWER]: Refusing update from remote peer 6e4c4dfb476946c2a688c9b0923c61ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:15.263039 14408 raft_consensus.cc:1261] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4 [term 1 FOLLOWER]: Refusing update from remote peer 6e4c4dfb476946c2a688c9b0923c61ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:15.263820 14941 consensus_queue.cc:1035] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "289ea24fa4e74117922751c05b6618e4" member_type: VOTER last_known_addr { host: "127.15.242.193" port: 38847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:15.264065 14952 consensus_queue.cc:1035] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e046926a56fa45b1906f95ef4fde268f" member_type: VOTER last_known_addr { host: "127.15.242.194" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:15.273008 14957 mvcc.cc:205] Tried to move back new op lower bound from 7315932181549342720 to 7315932181361512448. Current Snapshot: MvccSnapshot[applied={T|T < 7315932181549342720}]
I20260807 15:24:15.274827 14956 mvcc.cc:205] Tried to move back new op lower bound from 7315932181549342720 to 7315932181361512448. Current Snapshot: MvccSnapshot[applied={T|T < 7315932181549342720 or (T in {7315932181549342720})}]
I20260807 15:24:15.280797 14161 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:15.281000 14161 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 15:24:15.283497 14161 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75f29215b49f4aef90f2ecaf73a5da33: Sending DeleteTablet for 3 replicas of tablet 119363c7ee8240eb9dc98f7ce7743975
I20260807 15:24:15.284324 14585 tablet_service.cc:1514] Processing DeleteTablet for tablet 119363c7ee8240eb9dc98f7ce7743975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:15 UTC) from {username='slave'} at 127.0.0.1:49498
I20260807 15:24:15.284391 14801 tablet_service.cc:1514] Processing DeleteTablet for tablet 119363c7ee8240eb9dc98f7ce7743975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:15 UTC) from {username='slave'} at 127.0.0.1:54464
I20260807 15:24:15.284497 14363 tablet_service.cc:1514] Processing DeleteTablet for tablet 119363c7ee8240eb9dc98f7ce7743975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 15:24:15 UTC) from {username='slave'} at 127.0.0.1:59758
I20260807 15:24:15.284898 14967 tablet_replica.cc:330] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: stopping tablet replica
I20260807 15:24:15.285010 14969 tablet_replica.cc:330] T 119363c7ee8240eb9dc98f7ce7743975 P 289ea24fa4e74117922751c05b6618e4: stopping tablet replica
I20260807 15:24:15.285241 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 14249
I20260807 15:24:15.285261 14967 raft_consensus.cc:2229] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 15:24:15.294154 14967 raft_consensus.cc:2258] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:15.294692 14968 tablet_replica.cc:330] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: stopping tablet replica
I20260807 15:24:15.295049 14968 raft_consensus.cc:2229] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 1 LEADER]: Raft consensus shutting down.
I20260807 15:24:15.295462 14968 raft_consensus.cc:2258] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 15:24:15.297371 14967 ts_tablet_manager.cc:1905] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:15.298509 14968 ts_tablet_manager.cc:1905] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 15:24:15.300544 14967 ts_tablet_manager.cc:1918] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:15.300681 14967 log.cc:1196] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-1/wal/wals/119363c7ee8240eb9dc98f7ce7743975
I20260807 15:24:15.301067 14967 ts_tablet_manager.cc:1939] T 119363c7ee8240eb9dc98f7ce7743975 P e046926a56fa45b1906f95ef4fde268f: Deleting consensus metadata
I20260807 15:24:15.301774 14968 ts_tablet_manager.cc:1918] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 15:24:15.301882 14968 log.cc:1196] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Deleting WAL directory at /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786115983990396-16331-0/minicluster-data/ts-2/wal/wals/119363c7ee8240eb9dc98f7ce7743975
I20260807 15:24:15.302251 14968 ts_tablet_manager.cc:1939] T 119363c7ee8240eb9dc98f7ce7743975 P 6e4c4dfb476946c2a688c9b0923c61ca: Deleting consensus metadata
I20260807 15:24:15.302672 14147 catalog_manager.cc:4841] TS e046926a56fa45b1906f95ef4fde268f (127.15.242.194:41389): tablet 119363c7ee8240eb9dc98f7ce7743975 (table test-table [id=d1574fb334cc458180f7198d1a850446]) successfully deleted
I20260807 15:24:15.303470 14145 catalog_manager.cc:4841] TS 6e4c4dfb476946c2a688c9b0923c61ca (127.15.242.195:46541): tablet 119363c7ee8240eb9dc98f7ce7743975 (table test-table [id=d1574fb334cc458180f7198d1a850446]) successfully deleted
W20260807 15:24:15.309204 14146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.242.193:38847 (error 108)
I20260807 15:24:15.310125 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 14484
I20260807 15:24:15.316993 14971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:15.309994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.193:38847 (local address 127.0.0.1:59770)
0807 15:24:15.316718 (+ 6724us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:15.316862 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.193:38847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":63,"threads_started":1}
W20260807 15:24:15.317138 14146 catalog_manager.cc:4584] TS 289ea24fa4e74117922751c05b6618e4 (127.15.242.193:38847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 119363c7ee8240eb9dc98f7ce7743975: Network error: Client connection negotiation failed: client connection to 127.15.242.193:38847: connect: Connection refused (error 111)
I20260807 15:24:15.332231 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 14692
I20260807 15:24:15.347308 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 14122
2026-08-07T15:24:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1509 ms)
[----------] 6 tests from EncryptionPolicyTest (12426 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:15 dist-test-slave-g170 krb5kdc[14975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:15 dist-test-slave-g170 krb5kdc[14975](info): set up 2 sockets
Aug 07 15:24:15 dist-test-slave-g170 krb5kdc[14975](info): commencing operation
krb5kdc: starting...
W20260807 15:24:16.687249 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:16 dist-test-slave-g170 krb5kdc[14975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:16.824645 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:16.947099 14998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:16.947371 14998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:16.947412 14998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:16.951521 14998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:16.951587 14998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:16.951607 14998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:16.951623 14998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:16.951639 14998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:16.957050 14998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42265
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:16.958204 14998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:16.959333 14998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:16.968390 15006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:16.968451 15005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:16.968514 15010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:16.968545 14998 server_base.cc:1034] running on GCE node
I20260807 15:24:16.969436 14998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:16.970636 14998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:16.971823 14998 hybrid_clock.cc:648] HybridClock initialized: now 1786116256971803 us; error 32 us; skew 500 ppm
Aug 07 15:24:16 dist-test-slave-g170 krb5kdc[14975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116256, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:16.974895 14998 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:16.975934 14998 webserver.cc:460] Webserver started at http://127.0.0.1:34891/ using document root <none> and password file <none>
I20260807 15:24:16.976526 14998 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:16.976624 14998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:16.976935 14998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:16.979123 14998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "d81318ec16b04232b91460241da70d6c"
format_stamp: "Formatted at 2026-08-07 15:24:16 on dist-test-slave-g170"
server_key: "79b2223101c52be4228244a853ebf75b"
server_key_iv: "8cab09b3bbf9efb365df220f3f3ba5f9"
server_key_version: "encryptionkey@0"
I20260807 15:24:16.979736 14998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "d81318ec16b04232b91460241da70d6c"
format_stamp: "Formatted at 2026-08-07 15:24:16 on dist-test-slave-g170"
server_key: "79b2223101c52be4228244a853ebf75b"
server_key_iv: "8cab09b3bbf9efb365df220f3f3ba5f9"
server_key_version: "encryptionkey@0"
I20260807 15:24:16.984359 14998 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:24:16.987368 15017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:16.988653 14998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:24:16.988831 14998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "d81318ec16b04232b91460241da70d6c"
format_stamp: "Formatted at 2026-08-07 15:24:16 on dist-test-slave-g170"
server_key: "79b2223101c52be4228244a853ebf75b"
server_key_iv: "8cab09b3bbf9efb365df220f3f3ba5f9"
server_key_version: "encryptionkey@0"
I20260807 15:24:16.988951 14998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:16.999015 14998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:17.002419 14998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:17.002631 14998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:17.010495 14998 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42265
I20260807 15:24:17.010520 15100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42265 every 8 connection(s)
I20260807 15:24:17.011571 14998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:17.012396 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 14998
I20260807 15:24:17.012547 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:17.012923 16331 external_mini_cluster.cc:1428] Setting key 5398081b2bef01ce08a86e8279c1dd71
I20260807 15:24:17.015169 15101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:17.021136 15101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c: Bootstrap starting.
Aug 07 15:24:17 dist-test-slave-g170 krb5kdc[14975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 15:24:17.023766 15101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:17.024690 15101 log.cc:824] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:17.027330 15101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c: No bootstrap required, opened a new log
I20260807 15:24:17.029042 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:17.014422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45205 (local address 127.0.0.1:42265)
0807 15:24:17.014927 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:17.014943 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:17.014980 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:24:17.015753 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:17.015773 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:17.016135 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:17.016505 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:17.017437 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:17.018455 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:17.019360 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:17.019878 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:17.020067 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:17.022969 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:17.022975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:17.022991 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:17.023023 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:17.025374 (+ 2351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:17.026218 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:17.026224 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:17.026229 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:17.026359 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:17.026808 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:17.026811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:17.026812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:17.027283 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:17.027523 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:17.027846 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 15:24:17.028140 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":160,"threads_started":1}
I20260807 15:24:17.031418 15101 raft_consensus.cc:348] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d81318ec16b04232b91460241da70d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260807 15:24:17.031746 15101 raft_consensus.cc:374] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:17.031819 15101 raft_consensus.cc:729] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d81318ec16b04232b91460241da70d6c, State: Initialized, Role: FOLLOWER
I20260807 15:24:17.032305 15101 consensus_queue.cc:260] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d81318ec16b04232b91460241da70d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260807 15:24:17.032464 15101 raft_consensus.cc:388] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:17.032567 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:17.032603 15101 raft_consensus.cc:482] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:17.032719 15101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:17.034152 15101 raft_consensus.cc:504] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d81318ec16b04232b91460241da70d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260807 15:24:17.034540 15101 leader_election.cc:302] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d81318ec16b04232b91460241da70d6c; no voters:
I20260807 15:24:17.034914 15101 leader_election.cc:288] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:17.034998 15118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:17.035198 15118 raft_consensus.cc:686] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [term 1 LEADER]: Becoming Leader. State: Replica: d81318ec16b04232b91460241da70d6c, State: Running, Role: LEADER
I20260807 15:24:17.035542 15118 consensus_queue.cc:237] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d81318ec16b04232b91460241da70d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } }
I20260807 15:24:17.036311 15101 sys_catalog.cc:564] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:17.036752 15118 sys_catalog.cc:455] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d81318ec16b04232b91460241da70d6c. Latest consensus state: current_term: 1 leader_uuid: "d81318ec16b04232b91460241da70d6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d81318ec16b04232b91460241da70d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } } }
I20260807 15:24:17.036891 15118 sys_catalog.cc:458] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:17.037112 15118 sys_catalog.cc:455] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d81318ec16b04232b91460241da70d6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d81318ec16b04232b91460241da70d6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42265 } } }
I20260807 15:24:17.037225 15118 sys_catalog.cc:458] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:17.037411 15126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:17.040987 15126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:17.047763 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:17.035084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52281 (local address 127.0.0.1:42265)
0807 15:24:17.035219 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:17.035224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:17.038674 (+ 3450us) server_negotiation.cc:407] Connection header received
0807 15:24:17.039017 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:17.039020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:17.039093 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:17.039198 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:17.040096 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:17.040971 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:17.042312 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:17.042567 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:17.042687 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:17.044160 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:17.044164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:17.044167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:17.044193 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:17.045828 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:17.046418 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:17.046422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:17.046424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:17.046512 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:17.046850 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:17.046853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:17.046855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:17.047036 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:17.047195 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:17.047479 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 15:24:17.047576 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 15:24:17.048292 15126 catalog_manager.cc:1347] Generated new cluster ID: c949f5f842454d07a0e9829fe7014884
I20260807 15:24:17.048362 15126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:17.063148 15126 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:17.064113 15126 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:17.069968 15126 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d81318ec16b04232b91460241da70d6c: Generated new TSK 0
I20260807 15:24:17.070724 15126 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:17.081516 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 14998
W20260807 15:24:17.096002 14973 connection.cc:535] client connection to 127.0.0.1:42265 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42265): Connection reset by peer (error 104)
2026-08-07T15:24:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1733 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:17 dist-test-slave-g170 krb5kdc[15156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:17 dist-test-slave-g170 krb5kdc[15156](info): set up 2 sockets
Aug 07 15:24:17 dist-test-slave-g170 krb5kdc[15156](info): commencing operation
krb5kdc: starting...
W20260807 15:24:18.389276 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:18 dist-test-slave-g170 krb5kdc[15156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:18.540261 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34601
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:18.657099 15183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:18.657419 15183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:18.657512 15183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:18.661728 15183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:18.661820 15183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:18.661857 15183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:18.661913 15183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:18.661953 15183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:18.667289 15183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34601
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:18.668416 15183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:18.669513 15183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:18.680022 15193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:18.680028 15183 server_base.cc:1034] running on GCE node
W20260807 15:24:18.679978 15196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:18.679961 15192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:18.680907 15183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:18.682124 15183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:18.683331 15183 hybrid_clock.cc:648] HybridClock initialized: now 1786116258683291 us; error 50 us; skew 500 ppm
Aug 07 15:24:18 dist-test-slave-g170 krb5kdc[15156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116258, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:18.686247 15183 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:18.687160 15183 webserver.cc:460] Webserver started at http://127.0.0.1:43383/ using document root <none> and password file <none>
I20260807 15:24:18.687706 15183 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:18.687767 15183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:18.687951 15183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:18.690073 15183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "b65e7b5704cb4b6e9a3eaafc783c0173"
format_stamp: "Formatted at 2026-08-07 15:24:18 on dist-test-slave-g170"
server_key: "5151761db560d4fe749313a4adcbf6b5"
server_key_iv: "3473c1fd7c06a3cf898b816b3d776320"
server_key_version: "encryptionkey@0"
I20260807 15:24:18.690591 15183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "b65e7b5704cb4b6e9a3eaafc783c0173"
format_stamp: "Formatted at 2026-08-07 15:24:18 on dist-test-slave-g170"
server_key: "5151761db560d4fe749313a4adcbf6b5"
server_key_iv: "3473c1fd7c06a3cf898b816b3d776320"
server_key_version: "encryptionkey@0"
I20260807 15:24:18.694358 15183 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:18.697062 15204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:18.698565 15183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:18.698669 15183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "b65e7b5704cb4b6e9a3eaafc783c0173"
format_stamp: "Formatted at 2026-08-07 15:24:18 on dist-test-slave-g170"
server_key: "5151761db560d4fe749313a4adcbf6b5"
server_key_iv: "3473c1fd7c06a3cf898b816b3d776320"
server_key_version: "encryptionkey@0"
I20260807 15:24:18.698756 15183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:18.713558 15183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:18.716524 15183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:18.716684 15183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:18.724931 15183 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34601
I20260807 15:24:18.724957 15306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34601 every 8 connection(s)
I20260807 15:24:18.725921 15183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:18.727860 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 15183
I20260807 15:24:18.728013 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:18.728328 16331 external_mini_cluster.cc:1428] Setting key 7b7b5c379f4afed45eb9398e87e1dc9f
I20260807 15:24:18.728935 15307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:18.734905 15307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173: Bootstrap starting.
I20260807 15:24:18.737387 15307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:18.737401 15311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:18.729816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44991 (local address 127.0.0.1:34601)
0807 15:24:18.730287 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:18.730308 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:18.730344 (+ 36us) server_negotiation.cc:407] Connection header received
0807 15:24:18.730970 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:18.730985 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:18.731318 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:18.731648 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:18.732076 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:18.733140 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:18.734058 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:18.734544 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:18.734719 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:18.735670 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:18.735675 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:18.735687 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:18.736069 (+ 382us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:18.736123 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:18.736146 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:18.736300 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:18.736484 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 15:24:18.736626 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":149,"threads_started":1}
I20260807 15:24:18.738340 15307 log.cc:824] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:18.740677 15307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173: No bootstrap required, opened a new log
I20260807 15:24:18.740754 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:18.745028 15307 raft_consensus.cc:348] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b65e7b5704cb4b6e9a3eaafc783c0173" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } }
I20260807 15:24:18.745322 15307 raft_consensus.cc:374] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:18.745388 15307 raft_consensus.cc:729] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65e7b5704cb4b6e9a3eaafc783c0173, State: Initialized, Role: FOLLOWER
I20260807 15:24:18.745918 15307 consensus_queue.cc:260] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b65e7b5704cb4b6e9a3eaafc783c0173" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } }
I20260807 15:24:18.746109 15307 raft_consensus.cc:388] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:18.746207 15307 raft_consensus.cc:482] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:18.746349 15307 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:18.747334 15311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:18.742838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58341 (local address 127.0.0.1:34601)
0807 15:24:18.742975 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:18.742980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:18.743231 (+ 251us) server_negotiation.cc:407] Connection header received
0807 15:24:18.743339 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:18.743341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:18.743388 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:18.743459 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:18.743801 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:18.744329 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:18.745522 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:18.745758 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:18.745843 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:18.746814 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:18.746817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:18.746819 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:18.746830 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:18.746854 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:18.746864 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:18.746932 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:18.747100 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 15:24:18.747151 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 15:24:18.747610 15307 raft_consensus.cc:504] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b65e7b5704cb4b6e9a3eaafc783c0173" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } }
I20260807 15:24:18.747988 15307 leader_election.cc:302] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b65e7b5704cb4b6e9a3eaafc783c0173; no voters:
I20260807 15:24:18.748378 15307 leader_election.cc:288] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:18.748476 15322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:18.748703 15322 raft_consensus.cc:686] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [term 1 LEADER]: Becoming Leader. State: Replica: b65e7b5704cb4b6e9a3eaafc783c0173, State: Running, Role: LEADER
I20260807 15:24:18.749091 15322 consensus_queue.cc:237] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b65e7b5704cb4b6e9a3eaafc783c0173" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } }
I20260807 15:24:18.749718 15307 sys_catalog.cc:564] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:18.750849 15323 sys_catalog.cc:455] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b65e7b5704cb4b6e9a3eaafc783c0173" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b65e7b5704cb4b6e9a3eaafc783c0173" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } } }
I20260807 15:24:18.750988 15323 sys_catalog.cc:458] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:18.751251 15324 sys_catalog.cc:455] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b65e7b5704cb4b6e9a3eaafc783c0173. Latest consensus state: current_term: 1 leader_uuid: "b65e7b5704cb4b6e9a3eaafc783c0173" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b65e7b5704cb4b6e9a3eaafc783c0173" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34601 } } }
I20260807 15:24:18.751348 15324 sys_catalog.cc:458] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:18.751381 15336 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:18.754658 15336 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:18.760915 15336 catalog_manager.cc:1347] Generated new cluster ID: ce7c8954afc74647803d905205136c6d
I20260807 15:24:18.760993 15336 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:18.774875 15336 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:18.775879 15336 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:18.785127 15336 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b65e7b5704cb4b6e9a3eaafc783c0173: Generated new TSK 0
I20260807 15:24:18.786005 15336 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:18.795305 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 15183
W20260807 15:24:18.811457 15151 connection.cc:535] client connection to 127.0.0.1:34601 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34601): Connection reset by peer (error 104)
2026-08-07T15:24:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1715 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:18 dist-test-slave-g170 krb5kdc[15355](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:18 dist-test-slave-g170 krb5kdc[15355](info): set up 2 sockets
Aug 07 15:24:18 dist-test-slave-g170 krb5kdc[15355](info): commencing operation
krb5kdc: starting...
W20260807 15:24:20.150393 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:20 dist-test-slave-g170 krb5kdc[15355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:20.288170 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37075
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:20.408994 15377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:20.409266 15377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:20.409308 15377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:20.413292 15377 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:20.413355 15377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:20.413374 15377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:20.413391 15377 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:20.413406 15377 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:20.418689 15377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37075
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:20.419749 15377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:20.420756 15377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:20.429687 15389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:20.429754 15394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:20.429864 15377 server_base.cc:1034] running on GCE node
W20260807 15:24:20.429806 15390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:20.430625 15377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:20.431792 15377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:20.432992 15377 hybrid_clock.cc:648] HybridClock initialized: now 1786116260432971 us; error 34 us; skew 500 ppm
Aug 07 15:24:20 dist-test-slave-g170 krb5kdc[15355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116260, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:20.439443 15377 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:20.440438 15377 webserver.cc:460] Webserver started at http://127.0.0.1:39159/ using document root <none> and password file <none>
I20260807 15:24:20.441112 15377 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:20.441221 15377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:20.441473 15377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:20.443643 15377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "1a70174cc8f041289ae05e6096aa3994"
format_stamp: "Formatted at 2026-08-07 15:24:20 on dist-test-slave-g170"
server_key: "3a4c11877d08e845be0866e9a9547bfa"
server_key_iv: "e36f9e0f245f737cfbca5e7d4f5f281f"
server_key_version: "encryptionkey@0"
I20260807 15:24:20.444228 15377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "1a70174cc8f041289ae05e6096aa3994"
format_stamp: "Formatted at 2026-08-07 15:24:20 on dist-test-slave-g170"
server_key: "3a4c11877d08e845be0866e9a9547bfa"
server_key_iv: "e36f9e0f245f737cfbca5e7d4f5f281f"
server_key_version: "encryptionkey@0"
I20260807 15:24:20.448149 15377 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 15:24:20.450711 15403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:20.451911 15377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 15:24:20.452054 15377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "1a70174cc8f041289ae05e6096aa3994"
format_stamp: "Formatted at 2026-08-07 15:24:20 on dist-test-slave-g170"
server_key: "3a4c11877d08e845be0866e9a9547bfa"
server_key_iv: "e36f9e0f245f737cfbca5e7d4f5f281f"
server_key_version: "encryptionkey@0"
I20260807 15:24:20.452165 15377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:20.456892 15377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:20.459972 15377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:20.460176 15377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:20.468195 15377 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37075
I20260807 15:24:20.468207 15487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37075 every 8 connection(s)
I20260807 15:24:20.469213 15377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:20.472098 15488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:20.477344 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 15377
I20260807 15:24:20.477526 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:20.477820 16331 external_mini_cluster.cc:1428] Setting key 10663bad5722c26f94224cc3837e51d0
I20260807 15:24:20.478034 15488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994: Bootstrap starting.
I20260807 15:24:20.480605 15488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:20.481545 15488 log.cc:824] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:20.483155 15491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:20.479128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57359 (local address 127.0.0.1:37075)
0807 15:24:20.479564 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:20.479580 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:20.479617 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:24:20.480242 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:20.480259 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:20.480536 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:20.480907 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:20.481754 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:20.481759 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:20.481771 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:20.481782 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:20.481837 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:20.481856 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:20.481976 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:20.482089 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 15:24:20.482260 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":142,"threads_started":1}
I20260807 15:24:20.483801 15488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994: No bootstrap required, opened a new log
I20260807 15:24:20.486122 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:20.487867 15488 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70174cc8f041289ae05e6096aa3994" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37075 } }
I20260807 15:24:20.488127 15488 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:20.488231 15488 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a70174cc8f041289ae05e6096aa3994, State: Initialized, Role: FOLLOWER
I20260807 15:24:20.488746 15488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70174cc8f041289ae05e6096aa3994" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37075 } }
I20260807 15:24:20.488957 15488 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:20.489032 15488 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:20.489110 15488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:20.490411 15491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:20.488221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41227 (local address 127.0.0.1:37075)
0807 15:24:20.488353 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:20.488357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:20.488615 (+ 258us) server_negotiation.cc:407] Connection header received
0807 15:24:20.488729 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:20.488732 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:20.488808 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:20.488890 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:20.489791 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:20.489795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:20.489797 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:20.489824 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:20.489856 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:20.489870 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:20.489967 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:20.490161 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 15:24:20.490282 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 15:24:20.490649 15488 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70174cc8f041289ae05e6096aa3994" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37075 } }
I20260807 15:24:20.491024 15488 leader_election.cc:302] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a70174cc8f041289ae05e6096aa3994; no voters:
I20260807 15:24:20.491401 15488 leader_election.cc:288] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:20.491499 15501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:20.491729 15501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [term 1 LEADER]: Becoming Leader. State: Replica: 1a70174cc8f041289ae05e6096aa3994, State: Running, Role: LEADER
I20260807 15:24:20.492082 15501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70174cc8f041289ae05e6096aa3994" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37075 } }
I20260807 15:24:20.492694 15488 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:20.494155 15502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a70174cc8f041289ae05e6096aa3994" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70174cc8f041289ae05e6096aa3994" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37075 } } }
I20260807 15:24:20.494304 15502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:20.494233 15504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a70174cc8f041289ae05e6096aa3994. Latest consensus state: current_term: 1 leader_uuid: "1a70174cc8f041289ae05e6096aa3994" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70174cc8f041289ae05e6096aa3994" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37075 } } }
I20260807 15:24:20.494398 15504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:20.495529 15512 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:20.498739 15512 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:20.504658 15512 catalog_manager.cc:1347] Generated new cluster ID: ba57331dce444ae28bc936a0b0dda7ad
I20260807 15:24:20.504733 15512 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:20.530936 15512 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:20.531347 15512 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:20.539327 15512 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a70174cc8f041289ae05e6096aa3994: Generated new TSK 0
I20260807 15:24:20.540172 15512 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:20.544232 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 15377
2026-08-07T15:24:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1748 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:20 dist-test-slave-g170 krb5kdc[15529](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:20 dist-test-slave-g170 krb5kdc[15529](info): set up 2 sockets
Aug 07 15:24:20 dist-test-slave-g170 krb5kdc[15529](info): commencing operation
krb5kdc: starting...
W20260807 15:24:21.906343 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:21 dist-test-slave-g170 krb5kdc[15529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:22.045691 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40713
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:22.161391 15549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:22.161695 15549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:22.161794 15549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:22.165779 15549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:22.165866 15549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:22.165916 15549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:22.165972 15549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:22.166011 15549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:22.171413 15549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:22.172516 15549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:22.173606 15549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:22.182578 15559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:22.182621 15565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:22.182611 15558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:22.182991 15549 server_base.cc:1034] running on GCE node
I20260807 15:24:22.183548 15549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:22.184633 15549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:22.185801 15549 hybrid_clock.cc:648] HybridClock initialized: now 1786116262185779 us; error 35 us; skew 500 ppm
Aug 07 15:24:22 dist-test-slave-g170 krb5kdc[15529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116262, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:22.188874 15549 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:22.189812 15549 webserver.cc:460] Webserver started at http://127.0.0.1:42431/ using document root <none> and password file <none>
I20260807 15:24:22.190442 15549 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:22.190543 15549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:22.190797 15549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:22.193132 15549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "8e7b62104ee84734ba4ab51ead292977"
format_stamp: "Formatted at 2026-08-07 15:24:22 on dist-test-slave-g170"
server_key: "6ce1ce8d6afd17b9f2697a341d45235e"
server_key_iv: "f5248570dae59170c4aa54a4d7212708"
server_key_version: "encryptionkey@0"
I20260807 15:24:22.193753 15549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "8e7b62104ee84734ba4ab51ead292977"
format_stamp: "Formatted at 2026-08-07 15:24:22 on dist-test-slave-g170"
server_key: "6ce1ce8d6afd17b9f2697a341d45235e"
server_key_iv: "f5248570dae59170c4aa54a4d7212708"
server_key_version: "encryptionkey@0"
I20260807 15:24:22.197813 15549 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:24:22.200371 15575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:22.201705 15549 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:24:22.201858 15549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "8e7b62104ee84734ba4ab51ead292977"
format_stamp: "Formatted at 2026-08-07 15:24:22 on dist-test-slave-g170"
server_key: "6ce1ce8d6afd17b9f2697a341d45235e"
server_key_iv: "f5248570dae59170c4aa54a4d7212708"
server_key_version: "encryptionkey@0"
I20260807 15:24:22.201977 15549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:22.237461 15549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:22.240878 15549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:22.241111 15549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:22.249003 15549 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40713
I20260807 15:24:22.249022 15652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40713 every 8 connection(s)
I20260807 15:24:22.250053 15549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:22.253047 15653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:22.253479 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 15549
I20260807 15:24:22.253639 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:22.253968 16331 external_mini_cluster.cc:1428] Setting key 46cbe4a740d73d93d843501e376f0974
I20260807 15:24:22.259267 15653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977: Bootstrap starting.
I20260807 15:24:22.261624 15653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:22.262383 15653 log.cc:824] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977: Log is configured to *not* fsync() on all Append() calls
Aug 07 15:24:22 dist-test-slave-g170 krb5kdc[15529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 15:24:22.264331 15653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977: No bootstrap required, opened a new log
I20260807 15:24:22.268340 15653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7b62104ee84734ba4ab51ead292977" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40713 } }
I20260807 15:24:22.268673 15653 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:22.268776 15653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7b62104ee84734ba4ab51ead292977, State: Initialized, Role: FOLLOWER
I20260807 15:24:22.269292 15653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7b62104ee84734ba4ab51ead292977" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40713 } }
I20260807 15:24:22.269459 15653 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:22.269542 15653 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:22.269640 15653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:22.270151 15656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:22.255523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49025 (local address 127.0.0.1:40713)
0807 15:24:22.256034 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:22.256051 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:22.256089 (+ 38us) server_negotiation.cc:407] Connection header received
0807 15:24:22.256864 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:22.256886 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:22.257248 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:22.257613 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:22.258571 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:22.259680 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:22.260663 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:22.261246 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:22.261444 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:22.264263 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:22.264269 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:22.264285 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:22.264316 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:22.266228 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:22.266737 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:22.266743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:22.266747 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:22.266876 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:22.267198 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:22.267202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:22.267204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:22.267708 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:22.268067 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:22.268792 (+ 725us) server_negotiation.cc:299] Negotiation successful
0807 15:24:22.269122 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":143,"threads_started":1}
I20260807 15:24:22.270819 15653 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7b62104ee84734ba4ab51ead292977" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40713 } }
I20260807 15:24:22.271209 15653 leader_election.cc:302] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e7b62104ee84734ba4ab51ead292977; no voters:
I20260807 15:24:22.271569 15653 leader_election.cc:288] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:22.271821 15659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:22.272064 15659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [term 1 LEADER]: Becoming Leader. State: Replica: 8e7b62104ee84734ba4ab51ead292977, State: Running, Role: LEADER
I20260807 15:24:22.272421 15659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7b62104ee84734ba4ab51ead292977" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40713 } }
I20260807 15:24:22.272959 15653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:22.273692 15659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e7b62104ee84734ba4ab51ead292977. Latest consensus state: current_term: 1 leader_uuid: "8e7b62104ee84734ba4ab51ead292977" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7b62104ee84734ba4ab51ead292977" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40713 } } }
I20260807 15:24:22.273685 15660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e7b62104ee84734ba4ab51ead292977" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7b62104ee84734ba4ab51ead292977" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40713 } } }
I20260807 15:24:22.273928 15660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:22.273852 15659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:22.274538 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:22.274565 15665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:22.278436 15665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:22.285492 15665 catalog_manager.cc:1347] Generated new cluster ID: 61189f3d48b34f45b7666bfd438aa9f4
I20260807 15:24:22.285601 15665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:22.287509 15656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:22.277260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42699 (local address 127.0.0.1:40713)
0807 15:24:22.277395 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:22.277400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:22.278004 (+ 604us) server_negotiation.cc:407] Connection header received
0807 15:24:22.278359 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:22.278362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:22.278416 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:22.278507 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:22.279684 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:22.280462 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:22.281499 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:22.281769 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:22.281896 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:22.283672 (+ 1776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:22.283677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:22.283680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:22.283710 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:22.285657 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:22.286108 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:22.286111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:22.286114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:22.286206 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:22.286528 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:22.286532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:22.286534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:22.286732 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:22.286924 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:22.287191 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 15:24:22.287331 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:24:22.313791 15665 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:22.314821 15665 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:22.321197 15665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e7b62104ee84734ba4ab51ead292977: Generated new TSK 0
I20260807 15:24:22.321930 15665 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:22.331408 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 15549
2026-08-07T15:24:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1787 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:22 dist-test-slave-g170 krb5kdc[15703](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:22 dist-test-slave-g170 krb5kdc[15703](info): set up 2 sockets
Aug 07 15:24:22 dist-test-slave-g170 krb5kdc[15703](info): commencing operation
krb5kdc: starting...
W20260807 15:24:23.620151 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:23 dist-test-slave-g170 krb5kdc[15703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:23.761466 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46255
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:23.898625 15722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:23.898967 15722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:23.899022 15722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:23.903654 15722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:23.903743 15722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:23.903769 15722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:23.903791 15722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:23.903863 15722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:23.909730 15722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:23.910893 15722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:23.912107 15722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:23.921677 15729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:23.921746 15732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:23.921746 15727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:23.921913 15722 server_base.cc:1034] running on GCE node
I20260807 15:24:23.922662 15722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:23.923997 15722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:23.925227 15722 hybrid_clock.cc:648] HybridClock initialized: now 1786116263925203 us; error 45 us; skew 500 ppm
Aug 07 15:24:23 dist-test-slave-g170 krb5kdc[15703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116263, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:23.928296 15722 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:23.929370 15722 webserver.cc:460] Webserver started at http://127.0.0.1:41019/ using document root <none> and password file <none>
I20260807 15:24:23.930001 15722 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:23.930096 15722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:23.930354 15722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:23.932574 15722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "607587090a18445e93972d6703099345"
format_stamp: "Formatted at 2026-08-07 15:24:23 on dist-test-slave-g170"
server_key: "6ce24d17124b0de58b5a1688bd0a9f88"
server_key_iv: "c070a57baa32072ad51a763d97dedeaf"
server_key_version: "encryptionkey@0"
I20260807 15:24:23.933225 15722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "607587090a18445e93972d6703099345"
format_stamp: "Formatted at 2026-08-07 15:24:23 on dist-test-slave-g170"
server_key: "6ce24d17124b0de58b5a1688bd0a9f88"
server_key_iv: "c070a57baa32072ad51a763d97dedeaf"
server_key_version: "encryptionkey@0"
I20260807 15:24:23.937464 15722 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:24:23.940186 15744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:23.941574 15722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:24:23.941731 15722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "607587090a18445e93972d6703099345"
format_stamp: "Formatted at 2026-08-07 15:24:23 on dist-test-slave-g170"
server_key: "6ce24d17124b0de58b5a1688bd0a9f88"
server_key_iv: "c070a57baa32072ad51a763d97dedeaf"
server_key_version: "encryptionkey@0"
I20260807 15:24:23.941849 15722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:23.972934 15722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:23.976282 15722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:23.976528 15722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:23.984400 15722 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46255
I20260807 15:24:23.984431 15832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46255 every 8 connection(s)
I20260807 15:24:23.985405 15722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:23.988397 15833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:23.990857 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 15722
I20260807 15:24:23.991006 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:23.991367 16331 external_mini_cluster.cc:1428] Setting key 46c8673d386127cfa1703ca29720b5a2
I20260807 15:24:23.995366 15833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345: Bootstrap starting.
I20260807 15:24:23.997974 15833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:23.998836 15833 log.cc:824] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:24.001446 15833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345: No bootstrap required, opened a new log
I20260807 15:24:24.001637 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:23.992963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48859 (local address 127.0.0.1:46255)
0807 15:24:23.993454 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:23.993470 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:23.993507 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:24:23.994442 (+ 935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:23.994465 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:23.994896 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:23.995277 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:23.995738 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:23.996718 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:23.997720 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:23.998268 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:23.998467 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:23.999390 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:23.999395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:23.999410 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:23.999930 (+ 520us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:24.000002 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:24.000051 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:24.000177 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:24.000357 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 15:24:24.000596 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":150,"threads_started":1}
I20260807 15:24:24.004856 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:24.006208 15833 raft_consensus.cc:348] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607587090a18445e93972d6703099345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46255 } }
I20260807 15:24:24.006454 15833 raft_consensus.cc:374] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:24.006534 15833 raft_consensus.cc:729] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 607587090a18445e93972d6703099345, State: Initialized, Role: FOLLOWER
I20260807 15:24:24.007117 15833 consensus_queue.cc:260] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607587090a18445e93972d6703099345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46255 } }
I20260807 15:24:24.007305 15833 raft_consensus.cc:388] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:24.007397 15833 raft_consensus.cc:482] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:24.007539 15833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:24.008904 15833 raft_consensus.cc:504] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607587090a18445e93972d6703099345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46255 } }
I20260807 15:24:24.009346 15833 leader_election.cc:302] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 607587090a18445e93972d6703099345; no voters:
I20260807 15:24:24.009739 15833 leader_election.cc:288] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:24.009933 15848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:24.010280 15848 raft_consensus.cc:686] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [term 1 LEADER]: Becoming Leader. State: Replica: 607587090a18445e93972d6703099345, State: Running, Role: LEADER
I20260807 15:24:24.010630 15848 consensus_queue.cc:237] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607587090a18445e93972d6703099345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46255 } }
I20260807 15:24:24.011332 15833 sys_catalog.cc:564] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:24.012228 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:24.007044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34447 (local address 127.0.0.1:46255)
0807 15:24:24.007193 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:24.007197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:24.007429 (+ 232us) server_negotiation.cc:407] Connection header received
0807 15:24:24.007656 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:24.007662 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:24.007713 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:24.007792 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:24.008184 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:24.008825 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:24.010200 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:24.010549 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:24.010634 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:24.011682 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:24.011686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:24.011689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:24.011706 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:24.011740 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:24.011755 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:24.011843 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:24.011989 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 15:24:24.012052 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:24:24.012415 15848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 607587090a18445e93972d6703099345. Latest consensus state: current_term: 1 leader_uuid: "607587090a18445e93972d6703099345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607587090a18445e93972d6703099345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46255 } } }
I20260807 15:24:24.012564 15848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:24.013221 15849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "607587090a18445e93972d6703099345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "607587090a18445e93972d6703099345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46255 } } }
I20260807 15:24:24.013337 15849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:24.013809 15858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:24.017567 15858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:24.025331 15858 catalog_manager.cc:1347] Generated new cluster ID: 7255de4ffb254c92912e3d3c466ac949
I20260807 15:24:24.025449 15858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:24.045639 15858 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:24.046978 15858 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:24.054648 15858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 607587090a18445e93972d6703099345: Generated new TSK 0
I20260807 15:24:24.055471 15858 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:24.066201 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 15722
2026-08-07T15:24:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1731 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:24 dist-test-slave-g170 krb5kdc[15875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:24 dist-test-slave-g170 krb5kdc[15875](info): set up 2 sockets
Aug 07 15:24:24 dist-test-slave-g170 krb5kdc[15875](info): commencing operation
krb5kdc: starting...
W20260807 15:24:25.330879 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:25 dist-test-slave-g170 krb5kdc[15875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:25.468540 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45495
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45495
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:25.590124 15893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:25.590449 15893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:25.590524 15893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:25.594575 15893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:25.594676 15893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:25.594715 15893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:25.594777 15893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:25.594818 15893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:25.600102 15893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:25.601218 15893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:25.602276 15893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:25.611037 15910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:25.611055 15915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:25.611195 15893 server_base.cc:1034] running on GCE node
W20260807 15:24:25.611099 15911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:25.611963 15893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:25.613214 15893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:25.614408 15893 hybrid_clock.cc:648] HybridClock initialized: now 1786116265614393 us; error 27 us; skew 500 ppm
Aug 07 15:24:25 dist-test-slave-g170 krb5kdc[15875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116265, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:25.622219 15893 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:25.623198 15893 webserver.cc:460] Webserver started at http://127.0.0.1:33477/ using document root <none> and password file <none>
I20260807 15:24:25.623749 15893 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:25.623811 15893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:25.623980 15893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:25.626081 15893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "68f69ad487684665bd5aaf964ae978c6"
format_stamp: "Formatted at 2026-08-07 15:24:25 on dist-test-slave-g170"
server_key: "efa825cd1f08373a4e668a9eecfa27ac"
server_key_iv: "5da933b0ea16bef3d9f6a890e232dc6c"
server_key_version: "encryptionkey@0"
I20260807 15:24:25.626614 15893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "68f69ad487684665bd5aaf964ae978c6"
format_stamp: "Formatted at 2026-08-07 15:24:25 on dist-test-slave-g170"
server_key: "efa825cd1f08373a4e668a9eecfa27ac"
server_key_iv: "5da933b0ea16bef3d9f6a890e232dc6c"
server_key_version: "encryptionkey@0"
I20260807 15:24:25.630380 15893 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:25.633023 15926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:25.634403 15893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:25.634507 15893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "68f69ad487684665bd5aaf964ae978c6"
format_stamp: "Formatted at 2026-08-07 15:24:25 on dist-test-slave-g170"
server_key: "efa825cd1f08373a4e668a9eecfa27ac"
server_key_iv: "5da933b0ea16bef3d9f6a890e232dc6c"
server_key_version: "encryptionkey@0"
I20260807 15:24:25.634582 15893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:25.639395 15893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:25.642452 15893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:25.642594 15893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:25.650259 15893 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45495
I20260807 15:24:25.650291 16015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45495 every 8 connection(s)
I20260807 15:24:25.651155 15893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:25.654040 16016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:25.656405 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 15893
I20260807 15:24:25.656569 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:25.656986 16331 external_mini_cluster.cc:1428] Setting key c5820fe735221d10644ca0b4c6d00d86
I20260807 15:24:25.661006 16016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6: Bootstrap starting.
I20260807 15:24:25.662566 16020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:25.658471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44703 (local address 127.0.0.1:45495)
0807 15:24:25.658955 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:25.658970 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:25.659004 (+ 34us) server_negotiation.cc:407] Connection header received
0807 15:24:25.659905 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:25.659924 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:25.660204 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:25.660545 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:25.661425 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:25.661430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:25.661445 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:25.661456 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:25.661509 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:25.661528 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:25.661680 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:25.661762 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 15:24:25.661917 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":157,"threads_started":1}
I20260807 15:24:25.663538 16016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:25.664528 16016 log.cc:824] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:25.665714 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:25.666896 16016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6: No bootstrap required, opened a new log
I20260807 15:24:25.669555 16020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:25.667787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36275 (local address 127.0.0.1:45495)
0807 15:24:25.667900 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:25.667904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:25.668083 (+ 179us) server_negotiation.cc:407] Connection header received
0807 15:24:25.668248 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:25.668250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:25.668285 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:25.668367 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:25.669127 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:25.669131 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:25.669134 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:25.669152 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:25.669176 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:25.669186 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:25.669285 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:25.669395 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 15:24:25.669432 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 15:24:25.671458 16016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f69ad487684665bd5aaf964ae978c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45495 } }
I20260807 15:24:25.671689 16016 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:25.671774 16016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f69ad487684665bd5aaf964ae978c6, State: Initialized, Role: FOLLOWER
I20260807 15:24:25.672230 16016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f69ad487684665bd5aaf964ae978c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45495 } }
I20260807 15:24:25.672398 16016 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:25.672480 16016 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:25.672596 16016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:25.673566 16016 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f69ad487684665bd5aaf964ae978c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45495 } }
I20260807 15:24:25.673931 16016 leader_election.cc:302] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68f69ad487684665bd5aaf964ae978c6; no voters:
I20260807 15:24:25.674257 16016 leader_election.cc:288] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:25.674368 16027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:25.674618 16027 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [term 1 LEADER]: Becoming Leader. State: Replica: 68f69ad487684665bd5aaf964ae978c6, State: Running, Role: LEADER
I20260807 15:24:25.675009 16027 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f69ad487684665bd5aaf964ae978c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45495 } }
I20260807 15:24:25.675673 16016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:25.677068 16029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68f69ad487684665bd5aaf964ae978c6. Latest consensus state: current_term: 1 leader_uuid: "68f69ad487684665bd5aaf964ae978c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f69ad487684665bd5aaf964ae978c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45495 } } }
I20260807 15:24:25.677136 16028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68f69ad487684665bd5aaf964ae978c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68f69ad487684665bd5aaf964ae978c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45495 } } }
I20260807 15:24:25.677274 16029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:25.677289 16028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:25.677788 16040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:25.680666 16040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:25.685941 16040 catalog_manager.cc:1347] Generated new cluster ID: 199166a1a1144517a4a3a05fea2d850c
I20260807 15:24:25.686007 16040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:25.706979 16040 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:25.707363 16040 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:25.716303 16040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68f69ad487684665bd5aaf964ae978c6: Generated new TSK 0
I20260807 15:24:25.717087 16040 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:25.724011 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 15893
2026-08-07T15:24:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1653 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:25 dist-test-slave-g170 krb5kdc[16056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:25 dist-test-slave-g170 krb5kdc[16056](info): set up 2 sockets
Aug 07 15:24:25 dist-test-slave-g170 krb5kdc[16056](info): commencing operation
krb5kdc: starting...
W20260807 15:24:26.983886 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:27 dist-test-slave-g170 krb5kdc[16056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:27.129297 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36305
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:27.249644 16076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:27.249949 16076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:27.250030 16076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:27.254097 16076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:27.254191 16076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:27.254227 16076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:27.254287 16076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:27.254323 16076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:27.259815 16076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:27.260990 16076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:27.262015 16076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:27.271135 16082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:27.271134 16083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:27.271195 16076 server_base.cc:1034] running on GCE node
W20260807 15:24:27.271127 16086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:27.271931 16076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:27.273128 16076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:27.274312 16076 hybrid_clock.cc:648] HybridClock initialized: now 1786116267274282 us; error 41 us; skew 500 ppm
Aug 07 15:24:27 dist-test-slave-g170 krb5kdc[16056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:27.277328 16076 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:27.278316 16076 webserver.cc:460] Webserver started at http://127.0.0.1:44453/ using document root <none> and password file <none>
I20260807 15:24:27.278936 16076 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:27.279031 16076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:27.279279 16076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:27.281559 16076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "4a517cb495844091b5c0441ec5a3c2a8"
format_stamp: "Formatted at 2026-08-07 15:24:27 on dist-test-slave-g170"
server_key: "98175caa43994174a15bd1af483ceb71"
server_key_iv: "f6fdeacda43037eaf95e9f5ce5e624c3"
server_key_version: "encryptionkey@0"
I20260807 15:24:27.282171 16076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "4a517cb495844091b5c0441ec5a3c2a8"
format_stamp: "Formatted at 2026-08-07 15:24:27 on dist-test-slave-g170"
server_key: "98175caa43994174a15bd1af483ceb71"
server_key_iv: "f6fdeacda43037eaf95e9f5ce5e624c3"
server_key_version: "encryptionkey@0"
I20260807 15:24:27.286108 16076 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 15:24:27.288728 16098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:27.290148 16076 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:27.290309 16076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "4a517cb495844091b5c0441ec5a3c2a8"
format_stamp: "Formatted at 2026-08-07 15:24:27 on dist-test-slave-g170"
server_key: "98175caa43994174a15bd1af483ceb71"
server_key_iv: "f6fdeacda43037eaf95e9f5ce5e624c3"
server_key_version: "encryptionkey@0"
I20260807 15:24:27.290436 16076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:27.320482 16076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:27.323813 16076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:27.324028 16076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:27.331727 16076 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36305
I20260807 15:24:27.331753 16178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36305 every 8 connection(s)
I20260807 15:24:27.332708 16076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:27.335637 16179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:27.337934 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16076
I20260807 15:24:27.338112 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:27.338438 16331 external_mini_cluster.cc:1428] Setting key b23d768069b36b5e8b71fb856216c15b
I20260807 15:24:27.342258 16179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8: Bootstrap starting.
I20260807 15:24:27.345003 16179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:27.345896 16179 log.cc:824] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:27.348533 16179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8: No bootstrap required, opened a new log
Aug 07 15:24:27 dist-test-slave-g170 krb5kdc[16056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 15:24:27.353984 16179 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a517cb495844091b5c0441ec5a3c2a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36305 } }
I20260807 15:24:27.354329 16179 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:27.354399 16179 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a517cb495844091b5c0441ec5a3c2a8, State: Initialized, Role: FOLLOWER
I20260807 15:24:27.354933 16179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a517cb495844091b5c0441ec5a3c2a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36305 } }
I20260807 15:24:27.355113 16179 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:27.355193 16179 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:27.355299 16179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:27.355374 16184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:27.340102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:37533 (local address 127.0.0.1:36305)
0807 15:24:27.340572 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:27.340589 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:27.340626 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:24:27.341410 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:27.341429 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:27.341809 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:27.342104 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:27.343136 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:27.344221 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:27.345478 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:27.346020 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:27.346252 (+ 232us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:27.349377 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:27.349384 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:27.349403 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:27.349438 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:27.351717 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:27.352285 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:27.352293 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:27.352300 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:27.352456 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:27.352837 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:27.352842 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:27.352844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:27.353460 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:27.353714 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:27.354038 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 15:24:27.354310 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":161,"threads_started":1}
I20260807 15:24:27.356437 16179 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a517cb495844091b5c0441ec5a3c2a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36305 } }
I20260807 15:24:27.356868 16179 leader_election.cc:302] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a517cb495844091b5c0441ec5a3c2a8; no voters:
I20260807 15:24:27.357273 16179 leader_election.cc:288] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:27.357416 16189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:27.357653 16189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [term 1 LEADER]: Becoming Leader. State: Replica: 4a517cb495844091b5c0441ec5a3c2a8, State: Running, Role: LEADER
I20260807 15:24:27.358034 16189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a517cb495844091b5c0441ec5a3c2a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36305 } }
I20260807 15:24:27.358832 16179 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:27.359040 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:27.359310 16189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a517cb495844091b5c0441ec5a3c2a8. Latest consensus state: current_term: 1 leader_uuid: "4a517cb495844091b5c0441ec5a3c2a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a517cb495844091b5c0441ec5a3c2a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36305 } } }
I20260807 15:24:27.359483 16189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:27.359763 16190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a517cb495844091b5c0441ec5a3c2a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a517cb495844091b5c0441ec5a3c2a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36305 } } }
I20260807 15:24:27.359886 16190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:27.361485 16194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:27.365051 16194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:27.371610 16184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:27.361832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:33921 (local address 127.0.0.1:36305)
0807 15:24:27.362296 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:27.362301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:27.362317 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:24:27.362358 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:27.362361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:27.362411 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:27.362509 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:27.363476 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:27.364236 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:27.365383 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:27.365724 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:27.365847 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:27.367533 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:27.367539 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:27.367547 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:27.367570 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:27.369157 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:27.370093 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:27.370097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:27.370099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:27.370198 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:27.370603 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:27.370607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:27.370608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:27.370856 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:27.371012 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:27.371338 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 15:24:27.371448 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363}
I20260807 15:24:27.372115 16194 catalog_manager.cc:1347] Generated new cluster ID: 371863d2fed24b37a598689adcaa99f3
I20260807 15:24:27.372182 16194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:27.380499 16194 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:27.381783 16194 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:27.386088 16194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a517cb495844091b5c0441ec5a3c2a8: Generated new TSK 0
I20260807 15:24:27.386862 16194 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:27.396740 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16076
W20260807 15:24:27.415149 16054 connection.cc:535] client connection to 127.0.0.1:36305 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36305): Connection reset by peer (error 104)
2026-08-07T15:24:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1682 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:27 dist-test-slave-g170 krb5kdc[16227](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:27 dist-test-slave-g170 krb5kdc[16227](info): set up 2 sockets
Aug 07 15:24:27 dist-test-slave-g170 krb5kdc[16227](info): commencing operation
krb5kdc: starting...
W20260807 15:24:28.686062 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:28 dist-test-slave-g170 krb5kdc[16227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:28.825140 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46327
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:28.949007 16248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:28.949308 16248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:28.949352 16248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:28.953455 16248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:28.953521 16248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:28.953540 16248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:28.953557 16248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:28.953572 16248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:28.959050 16248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:28.960212 16248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:28.961314 16248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:28.970474 16259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:28.970508 16256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:28.970502 16254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:28.970630 16248 server_base.cc:1034] running on GCE node
I20260807 15:24:28.971312 16248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:28.972522 16248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:28.973773 16248 hybrid_clock.cc:648] HybridClock initialized: now 1786116268973749 us; error 37 us; skew 500 ppm
Aug 07 15:24:28 dist-test-slave-g170 krb5kdc[16227](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116268, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:28.976697 16248 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:28.977710 16248 webserver.cc:460] Webserver started at http://127.0.0.1:45449/ using document root <none> and password file <none>
I20260807 15:24:28.978295 16248 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:28.978374 16248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:28.978598 16248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:28.980691 16248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "9a2b39f92bb541cfbf1d2d328956fb1d"
format_stamp: "Formatted at 2026-08-07 15:24:28 on dist-test-slave-g170"
server_key: "540f7e2228b5a7639dda1c3b4a93f227"
server_key_iv: "ee1457091934d1c1355f813b467c80e8"
server_key_version: "encryptionkey@0"
I20260807 15:24:28.981355 16248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "9a2b39f92bb541cfbf1d2d328956fb1d"
format_stamp: "Formatted at 2026-08-07 15:24:28 on dist-test-slave-g170"
server_key: "540f7e2228b5a7639dda1c3b4a93f227"
server_key_iv: "ee1457091934d1c1355f813b467c80e8"
server_key_version: "encryptionkey@0"
I20260807 15:24:28.985634 16248 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:24:28.988621 16278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:28.990170 16248 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 15:24:28.990358 16248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "9a2b39f92bb541cfbf1d2d328956fb1d"
format_stamp: "Formatted at 2026-08-07 15:24:28 on dist-test-slave-g170"
server_key: "540f7e2228b5a7639dda1c3b4a93f227"
server_key_iv: "ee1457091934d1c1355f813b467c80e8"
server_key_version: "encryptionkey@0"
I20260807 15:24:28.990490 16248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:29.006496 16248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:29.010895 16248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:29.011147 16248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:29.018872 16248 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46327
I20260807 15:24:29.018893 16364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46327 every 8 connection(s)
I20260807 15:24:29.019996 16248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:29.023320 16365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:29.024240 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16248
I20260807 15:24:29.024407 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:29.024802 16331 external_mini_cluster.cc:1428] Setting key 7e255408029f8d49b7f0361160b9d80d
I20260807 15:24:29.030431 16365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d: Bootstrap starting.
I20260807 15:24:29.033169 16365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:29.034080 16365 log.cc:824] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:29.035507 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:29.026532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:33565 (local address 127.0.0.1:46327)
0807 15:24:29.027054 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:29.027070 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:29.027110 (+ 40us) server_negotiation.cc:407] Connection header received
0807 15:24:29.027791 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:29.027809 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:29.028172 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:29.028546 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:29.029052 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:29.030047 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:29.031064 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:29.031538 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:29.031732 (+ 194us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:29.032852 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:29.032858 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:29.032874 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:29.033404 (+ 530us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:29.033471 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:29.033499 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:29.033772 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:29.033978 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 15:24:29.034154 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":150,"threads_started":1}
I20260807 15:24:29.036971 16365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d: No bootstrap required, opened a new log
I20260807 15:24:29.043110 16365 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2b39f92bb541cfbf1d2d328956fb1d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46327 } }
I20260807 15:24:29.043497 16365 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:29.043614 16365 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2b39f92bb541cfbf1d2d328956fb1d, State: Initialized, Role: FOLLOWER
I20260807 15:24:29.043653 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:29.044195 16365 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2b39f92bb541cfbf1d2d328956fb1d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46327 } }
I20260807 15:24:29.044396 16365 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:29.044479 16365 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:29.044596 16365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:29.045918 16365 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2b39f92bb541cfbf1d2d328956fb1d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46327 } }
I20260807 15:24:29.046370 16365 leader_election.cc:302] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a2b39f92bb541cfbf1d2d328956fb1d; no voters:
I20260807 15:24:29.046763 16365 leader_election.cc:288] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:29.048250 16365 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:29.049062 16381 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:29.049328 16381 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [term 1 LEADER]: Becoming Leader. State: Replica: 9a2b39f92bb541cfbf1d2d328956fb1d, State: Running, Role: LEADER
I20260807 15:24:29.050236 16381 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2b39f92bb541cfbf1d2d328956fb1d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46327 } }
I20260807 15:24:29.051862 16381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a2b39f92bb541cfbf1d2d328956fb1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2b39f92bb541cfbf1d2d328956fb1d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46327 } } }
I20260807 15:24:29.052063 16381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:29.052559 16381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a2b39f92bb541cfbf1d2d328956fb1d. Latest consensus state: current_term: 1 leader_uuid: "9a2b39f92bb541cfbf1d2d328956fb1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a2b39f92bb541cfbf1d2d328956fb1d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46327 } } }
I20260807 15:24:29.052958 16381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:29.056546 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:29.049860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:33071 (local address 127.0.0.1:46327)
0807 15:24:29.049996 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:29.050004 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:29.051485 (+ 1481us) server_negotiation.cc:407] Connection header received
0807 15:24:29.051540 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:29.051544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:29.051614 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:29.051682 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:29.052258 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:29.053179 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:29.054475 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:29.054815 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:29.054950 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:29.055965 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:29.055970 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:29.055973 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:29.055989 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:29.056020 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:29.056036 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:29.056162 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:29.056362 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 15:24:29.056404 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 15:24:29.056903 16411 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:29.056988 16411 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:29.057055 16410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:29.058007 16410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:29.064080 16410 catalog_manager.cc:1347] Generated new cluster ID: c61469609d8b48bc8c1dfeeda1ba0b3c
I20260807 15:24:29.064172 16410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:29.096618 16410 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:29.098119 16410 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:29.104838 16410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a2b39f92bb541cfbf1d2d328956fb1d: Generated new TSK 0
I20260807 15:24:29.105587 16410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:29.117507 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16248
W20260807 15:24:29.137740 16224 connection.cc:535] client connection to 127.0.0.1:46327 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46327): Connection reset by peer (error 104)
2026-08-07T15:24:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1721 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:29 dist-test-slave-g170 krb5kdc[16417](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:29 dist-test-slave-g170 krb5kdc[16417](info): set up 2 sockets
Aug 07 15:24:29 dist-test-slave-g170 krb5kdc[16417](info): commencing operation
krb5kdc: starting...
W20260807 15:24:30.412569 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:30 dist-test-slave-g170 krb5kdc[16417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:30.560599 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37139
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:30.675060 16441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:30.675388 16441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:30.675470 16441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:30.679949 16441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:30.680071 16441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:30.680115 16441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:30.680156 16441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:30.680192 16441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:30.685652 16441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:30.686774 16441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:30.687855 16441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:30.696951 16449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:30.697010 16448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:30.697137 16441 server_base.cc:1034] running on GCE node
W20260807 15:24:30.696951 16452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:30.697857 16441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:30.699013 16441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:30.700192 16441 hybrid_clock.cc:648] HybridClock initialized: now 1786116270700175 us; error 34 us; skew 500 ppm
Aug 07 15:24:30 dist-test-slave-g170 krb5kdc[16417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116270, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:30.709538 16441 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:30.710563 16441 webserver.cc:460] Webserver started at http://127.0.0.1:46301/ using document root <none> and password file <none>
I20260807 15:24:30.711176 16441 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:30.711287 16441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:30.711535 16441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:30.713800 16441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca"
format_stamp: "Formatted at 2026-08-07 15:24:30 on dist-test-slave-g170"
server_key: "b4740619531b217c4a0b3577ba6d3d84"
server_key_iv: "c96e1e00c6750026a1aa2d19de2c6c0f"
server_key_version: "encryptionkey@0"
I20260807 15:24:30.714408 16441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca"
format_stamp: "Formatted at 2026-08-07 15:24:30 on dist-test-slave-g170"
server_key: "b4740619531b217c4a0b3577ba6d3d84"
server_key_iv: "c96e1e00c6750026a1aa2d19de2c6c0f"
server_key_version: "encryptionkey@0"
I20260807 15:24:30.718429 16441 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:30.721158 16467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:30.722573 16441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 15:24:30.722741 16441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca"
format_stamp: "Formatted at 2026-08-07 15:24:30 on dist-test-slave-g170"
server_key: "b4740619531b217c4a0b3577ba6d3d84"
server_key_iv: "c96e1e00c6750026a1aa2d19de2c6c0f"
server_key_version: "encryptionkey@0"
I20260807 15:24:30.722890 16441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:30.728190 16441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:30.731462 16441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:30.731684 16441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:30.740113 16441 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37139
I20260807 15:24:30.740123 16542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37139 every 8 connection(s)
I20260807 15:24:30.741251 16441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:30.744129 16543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:30.747614 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16441
I20260807 15:24:30.747826 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:30.748160 16331 external_mini_cluster.cc:1428] Setting key 9e5e2c3379310b5660211f5d904717ae
I20260807 15:24:30.750208 16543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca: Bootstrap starting.
I20260807 15:24:30.752893 16543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:30.753723 16543 log.cc:824] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:30.753938 16548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:30.749688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:39067 (local address 127.0.0.1:37139)
0807 15:24:30.750160 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:30.750182 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:30.750222 (+ 40us) server_negotiation.cc:407] Connection header received
0807 15:24:30.750954 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:30.750973 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:30.751285 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:30.751612 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:30.752535 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:30.752540 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:30.752554 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:30.752566 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:30.752626 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:30.752648 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:30.752748 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:30.752950 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 15:24:30.753142 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":147,"threads_started":1}
I20260807 15:24:30.755971 16543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca: No bootstrap required, opened a new log
I20260807 15:24:30.757043 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:30.760170 16543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37139 } }
I20260807 15:24:30.760465 16543 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:30.760521 16543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bce68b01a8f4bf1b1388e49c6c0f2ca, State: Initialized, Role: FOLLOWER
I20260807 15:24:30.761039 16543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37139 } }
I20260807 15:24:30.761200 16548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:30.759352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:36361 (local address 127.0.0.1:37139)
0807 15:24:30.759480 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:30.759484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:30.759634 (+ 150us) server_negotiation.cc:407] Connection header received
0807 15:24:30.759792 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:30.759795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:30.759830 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:30.759914 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:30.760654 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:30.760658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:30.760661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:30.760675 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:30.760713 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:30.760725 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:30.760883 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:30.761005 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 15:24:30.761053 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 15:24:30.761232 16543 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:30.761314 16543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:30.761428 16543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:30.762648 16543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37139 } }
I20260807 15:24:30.763011 16543 leader_election.cc:302] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bce68b01a8f4bf1b1388e49c6c0f2ca; no voters:
I20260807 15:24:30.763336 16543 leader_election.cc:288] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:30.763487 16556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:30.763772 16556 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [term 1 LEADER]: Becoming Leader. State: Replica: 8bce68b01a8f4bf1b1388e49c6c0f2ca, State: Running, Role: LEADER
I20260807 15:24:30.764139 16556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37139 } }
I20260807 15:24:30.764652 16543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:30.766058 16558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37139 } } }
I20260807 15:24:30.766196 16558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:30.766577 16560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bce68b01a8f4bf1b1388e49c6c0f2ca. Latest consensus state: current_term: 1 leader_uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bce68b01a8f4bf1b1388e49c6c0f2ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37139 } } }
I20260807 15:24:30.766687 16560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca [sys.catalog]: This master's current role is: LEADER
W20260807 15:24:30.770184 16584 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:30.770267 16584 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:30.770359 16574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:30.771214 16574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:30.777249 16574 catalog_manager.cc:1347] Generated new cluster ID: e13175e3154b4450a8ba5d3d103c3333
I20260807 15:24:30.777334 16574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:30.808810 16574 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:30.809202 16574 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:30.819914 16574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8bce68b01a8f4bf1b1388e49c6c0f2ca: Generated new TSK 0
I20260807 15:24:30.820714 16574 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:30.832342 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16441
2026-08-07T15:24:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1710 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:30 dist-test-slave-g170 krb5kdc[16596](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:30 dist-test-slave-g170 krb5kdc[16596](info): set up 2 sockets
Aug 07 15:24:30 dist-test-slave-g170 krb5kdc[16596](info): commencing operation
krb5kdc: starting...
W20260807 15:24:32.112018 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:32 dist-test-slave-g170 krb5kdc[16596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:32.244359 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43553
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:32.360904 16616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:32.361152 16616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:32.361193 16616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:32.365022 16616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:32.365065 16616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:32.365083 16616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:32.365099 16616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:32.365114 16616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:32.370113 16616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:32.371065 16616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:32.372013 16616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:32.381038 16623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:32.381202 16616 server_base.cc:1034] running on GCE node
W20260807 15:24:32.381093 16622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:32.381078 16625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:32.381991 16616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:32.383527 16616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:32.384691 16616 hybrid_clock.cc:648] HybridClock initialized: now 1786116272384659 us; error 47 us; skew 500 ppm
Aug 07 15:24:32 dist-test-slave-g170 krb5kdc[16596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116272, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:32.387748 16616 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:32.388747 16616 webserver.cc:460] Webserver started at http://127.0.0.1:46607/ using document root <none> and password file <none>
I20260807 15:24:32.389392 16616 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:32.389461 16616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:32.389642 16616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:32.391856 16616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "e01a74f058f14d608846f08aa3fd02f0"
format_stamp: "Formatted at 2026-08-07 15:24:32 on dist-test-slave-g170"
server_key: "a7803a40a2f956fe96b2f220218b736f"
server_key_iv: "10020da6be2df136b0baa95587766a2f"
server_key_version: "encryptionkey@0"
I20260807 15:24:32.392508 16616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "e01a74f058f14d608846f08aa3fd02f0"
format_stamp: "Formatted at 2026-08-07 15:24:32 on dist-test-slave-g170"
server_key: "a7803a40a2f956fe96b2f220218b736f"
server_key_iv: "10020da6be2df136b0baa95587766a2f"
server_key_version: "encryptionkey@0"
I20260807 15:24:32.396682 16616 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260807 15:24:32.399333 16636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:32.400707 16616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 15:24:32.400926 16616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "e01a74f058f14d608846f08aa3fd02f0"
format_stamp: "Formatted at 2026-08-07 15:24:32 on dist-test-slave-g170"
server_key: "a7803a40a2f956fe96b2f220218b736f"
server_key_iv: "10020da6be2df136b0baa95587766a2f"
server_key_version: "encryptionkey@0"
I20260807 15:24:32.401038 16616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:32.436220 16616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:32.439842 16616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:32.440021 16616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:32.448156 16616 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43553
I20260807 15:24:32.448196 16719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43553 every 8 connection(s)
I20260807 15:24:32.449240 16616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:32.452143 16720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:32.452226 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16616
I20260807 15:24:32.452394 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:32.452700 16331 external_mini_cluster.cc:1428] Setting key 8daa106a88d37cd4bc98d80a0ba15945
I20260807 15:24:32.459525 16720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0: Bootstrap starting.
Aug 07 15:24:32 dist-test-slave-g170 krb5kdc[16596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 15:24:32.462455 16720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:32.463244 16720 log.cc:824] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:32.465229 16720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0: No bootstrap required, opened a new log
I20260807 15:24:32.467583 16725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:32.454204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:36311 (local address 127.0.0.1:43553)
0807 15:24:32.454652 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:32.454679 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:32.454721 (+ 42us) server_negotiation.cc:407] Connection header received
0807 15:24:32.455425 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:32.455443 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:32.455783 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:32.456079 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:32.457151 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:32.458147 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:32.459348 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:32.459859 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:32.459976 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:32.462887 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:32.462892 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:32.462906 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:32.462933 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:32.464655 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:32.465209 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:32.465216 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:32.465221 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:32.465387 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:32.465756 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:32.465759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:32.465761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:32.466133 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:32.466358 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:32.466682 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 15:24:32.466908 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":154,"threads_started":1}
I20260807 15:24:32.468930 16720 raft_consensus.cc:348] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01a74f058f14d608846f08aa3fd02f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43553 } }
I20260807 15:24:32.469168 16720 raft_consensus.cc:374] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:32.469265 16720 raft_consensus.cc:729] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01a74f058f14d608846f08aa3fd02f0, State: Initialized, Role: FOLLOWER
I20260807 15:24:32.469741 16720 consensus_queue.cc:260] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01a74f058f14d608846f08aa3fd02f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43553 } }
I20260807 15:24:32.469892 16720 raft_consensus.cc:388] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:32.469961 16720 raft_consensus.cc:482] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:32.470065 16720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:32.470748 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:32.471109 16720 raft_consensus.cc:504] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01a74f058f14d608846f08aa3fd02f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43553 } }
I20260807 15:24:32.471446 16720 leader_election.cc:302] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e01a74f058f14d608846f08aa3fd02f0; no voters:
I20260807 15:24:32.471771 16720 leader_election.cc:288] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:32.471880 16727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:32.472154 16727 raft_consensus.cc:686] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [term 1 LEADER]: Becoming Leader. State: Replica: e01a74f058f14d608846f08aa3fd02f0, State: Running, Role: LEADER
I20260807 15:24:32.472532 16727 consensus_queue.cc:237] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01a74f058f14d608846f08aa3fd02f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43553 } }
I20260807 15:24:32.473157 16720 sys_catalog.cc:564] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:32.474455 16735 sys_catalog.cc:455] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e01a74f058f14d608846f08aa3fd02f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01a74f058f14d608846f08aa3fd02f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43553 } } }
I20260807 15:24:32.474591 16735 sys_catalog.cc:458] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:32.474978 16739 sys_catalog.cc:455] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e01a74f058f14d608846f08aa3fd02f0. Latest consensus state: current_term: 1 leader_uuid: "e01a74f058f14d608846f08aa3fd02f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e01a74f058f14d608846f08aa3fd02f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43553 } } }
I20260807 15:24:32.475118 16739 sys_catalog.cc:458] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0 [sys.catalog]: This master's current role is: LEADER
W20260807 15:24:32.478654 16760 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:32.478754 16760 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:32.478859 16752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:32.479743 16752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:32.485829 16752 catalog_manager.cc:1347] Generated new cluster ID: fadf8f308ace4e9bb36e58672629be78
I20260807 15:24:32.485896 16752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:32.486299 16725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:32.472893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:39551 (local address 127.0.0.1:43553)
0807 15:24:32.473025 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:32.473029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:32.476061 (+ 3032us) server_negotiation.cc:407] Connection header received
0807 15:24:32.476188 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:32.476191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:32.476245 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:32.476332 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:32.477071 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:32.477825 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:32.478994 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:32.479349 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:32.479459 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:32.481190 (+ 1731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:32.481196 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:32.481200 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:32.481235 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:32.484385 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:32.484928 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:32.484931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:32.484932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:32.485007 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:32.485369 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:32.485373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:32.485374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:32.485550 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:32.485708 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:32.486035 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 15:24:32.486147 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 15:24:32.491978 16752 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:32.492847 16752 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:32.500098 16752 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e01a74f058f14d608846f08aa3fd02f0: Generated new TSK 0
I20260807 15:24:32.500888 16752 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:32.507268 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16616
W20260807 15:24:32.523277 16594 connection.cc:535] client connection to 127.0.0.1:43553 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43553): Connection reset by peer (error 104)
2026-08-07T15:24:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1674 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:32 dist-test-slave-g170 krb5kdc[16767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:32 dist-test-slave-g170 krb5kdc[16767](info): set up 2 sockets
Aug 07 15:24:32 dist-test-slave-g170 krb5kdc[16767](info): commencing operation
krb5kdc: starting...
W20260807 15:24:33.879685 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.342s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:33 dist-test-slave-g170 krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:34.021512 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37633
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37633
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:34.145200 16787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:34.145493 16787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:34.145535 16787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:34.149695 16787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:34.149775 16787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:34.149794 16787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:34.149811 16787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:34.149827 16787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:34.155289 16787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37633
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:34.156451 16787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:34.157582 16787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:34.166476 16798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:34.166467 16793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:34.166621 16787 server_base.cc:1034] running on GCE node
W20260807 15:24:34.166501 16794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:34.167407 16787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:34.168476 16787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:34.169677 16787 hybrid_clock.cc:648] HybridClock initialized: now 1786116274169628 us; error 65 us; skew 500 ppm
Aug 07 15:24:34 dist-test-slave-g170 krb5kdc[16767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116274, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:34.172636 16787 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:34.173648 16787 webserver.cc:460] Webserver started at http://127.0.0.1:35141/ using document root <none> and password file <none>
I20260807 15:24:34.174227 16787 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:34.174320 16787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:34.174561 16787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:34.176609 16787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7"
format_stamp: "Formatted at 2026-08-07 15:24:34 on dist-test-slave-g170"
server_key: "eadf2928ac1e23d11435a258a2bba271"
server_key_iv: "be8f48fd63707ca7c499cfe10c1e1470"
server_key_version: "encryptionkey@0"
I20260807 15:24:34.177276 16787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7"
format_stamp: "Formatted at 2026-08-07 15:24:34 on dist-test-slave-g170"
server_key: "eadf2928ac1e23d11435a258a2bba271"
server_key_iv: "be8f48fd63707ca7c499cfe10c1e1470"
server_key_version: "encryptionkey@0"
I20260807 15:24:34.181125 16787 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 15:24:34.183547 16807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:34.184882 16787 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:24:34.185024 16787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7"
format_stamp: "Formatted at 2026-08-07 15:24:34 on dist-test-slave-g170"
server_key: "eadf2928ac1e23d11435a258a2bba271"
server_key_iv: "be8f48fd63707ca7c499cfe10c1e1470"
server_key_version: "encryptionkey@0"
I20260807 15:24:34.185137 16787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:34.198012 16787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:34.201583 16787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:34.201812 16787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:34.209657 16787 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37633
I20260807 15:24:34.209685 16888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37633 every 8 connection(s)
I20260807 15:24:34.210736 16787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:34.213879 16889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:34.219710 16889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7: Bootstrap starting.
I20260807 15:24:34.220319 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16787
I20260807 15:24:34.220461 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:34.220737 16331 external_mini_cluster.cc:1428] Setting key c0f50302863409fb3e1f88728891885b
I20260807 15:24:34.222663 16889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:34.223573 16889 log.cc:824] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:34.225950 16889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7: No bootstrap required, opened a new log
I20260807 15:24:34.230381 16889 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } }
I20260807 15:24:34.230661 16889 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:34.230736 16889 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93d9ca7bcc5b4bdb8f6d59430d64e1f7, State: Initialized, Role: FOLLOWER
I20260807 15:24:34.231225 16889 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } }
I20260807 15:24:34.231328 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:34.222208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:38079 (local address 127.0.0.1:37633)
0807 15:24:34.222675 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:34.222699 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:34.222744 (+ 45us) server_negotiation.cc:407] Connection header received
0807 15:24:34.223656 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:34.223686 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:34.224138 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:34.224527 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:34.224990 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:34.226419 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:34.227324 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:34.228055 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:34.228214 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:34.229220 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:34.229227 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:34.229244 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:34.229776 (+ 532us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:34.229846 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:34.229877 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:34.230020 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:34.230183 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 15:24:34.230315 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":122,"threads_started":1}
I20260807 15:24:34.231395 16889 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:34.231451 16889 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:34.231600 16889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:34.232492 16889 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } }
I20260807 15:24:34.232887 16889 leader_election.cc:302] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93d9ca7bcc5b4bdb8f6d59430d64e1f7; no voters:
I20260807 15:24:34.233242 16889 leader_election.cc:288] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:34.233371 16900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:34.233595 16900 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [term 1 LEADER]: Becoming Leader. State: Replica: 93d9ca7bcc5b4bdb8f6d59430d64e1f7, State: Running, Role: LEADER
I20260807 15:24:34.233956 16900 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } }
I20260807 15:24:34.234431 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:34.234630 16889 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:34.237100 16901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } } }
I20260807 15:24:34.237372 16901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:34.237629 16902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93d9ca7bcc5b4bdb8f6d59430d64e1f7. Latest consensus state: current_term: 1 leader_uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d9ca7bcc5b4bdb8f6d59430d64e1f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37633 } } }
I20260807 15:24:34.237799 16902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7 [sys.catalog]: This master's current role is: LEADER
W20260807 15:24:34.240285 16926 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:34.240371 16926 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:34.240571 16935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:34.241583 16935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:34.242626 16892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:34.237526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:33933 (local address 127.0.0.1:37633)
0807 15:24:34.237667 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:34.237674 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:34.237963 (+ 289us) server_negotiation.cc:407] Connection header received
0807 15:24:34.238172 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:34.238176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:34.238231 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:34.238335 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:34.238598 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:34.239387 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:34.240564 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:34.240946 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:34.241063 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:34.242065 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:34.242070 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:34.242073 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:34.242096 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:34.242126 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:34.242142 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:34.242237 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:34.242439 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 15:24:34.242480 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 15:24:34.247545 16935 catalog_manager.cc:1347] Generated new cluster ID: 857df7dedfa746ac82fc8db5c1656e56
I20260807 15:24:34.247624 16935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:34.278406 16935 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:34.279362 16935 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:34.292543 16935 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93d9ca7bcc5b4bdb8f6d59430d64e1f7: Generated new TSK 0
I20260807 15:24:34.293347 16935 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:34.302814 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16787
W20260807 15:24:34.318913 16764 connection.cc:535] client connection to 127.0.0.1:37633 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37633): Connection reset by peer (error 104)
2026-08-07T15:24:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1795 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:34 dist-test-slave-g170 krb5kdc[16943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:34 dist-test-slave-g170 krb5kdc[16943](info): set up 2 sockets
Aug 07 15:24:34 dist-test-slave-g170 krb5kdc[16943](info): commencing operation
krb5kdc: starting...
W20260807 15:24:35.601593 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:35 dist-test-slave-g170 krb5kdc[16943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 15:24:35.739638 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45923
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:35.866253 16963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:35.866564 16963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:35.866613 16963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:35.871184 16963 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:35.871254 16963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:35.871274 16963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:35.871291 16963 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:35.871306 16963 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:35.876739 16963 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45923
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:35.877912 16963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:35.878993 16963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:35.888003 16975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:35.888195 16963 server_base.cc:1034] running on GCE node
W20260807 15:24:35.888033 16971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:35.888078 16972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:35.888923 16963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:35.890064 16963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:35.891275 16963 hybrid_clock.cc:648] HybridClock initialized: now 1786116275891226 us; error 48 us; skew 500 ppm
Aug 07 15:24:35 dist-test-slave-g170 krb5kdc[16943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116275, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:35.898451 16963 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 15:24:35.899497 16963 webserver.cc:460] Webserver started at http://127.0.0.1:40931/ using document root <none> and password file <none>
I20260807 15:24:35.900164 16963 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:35.900233 16963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:35.900470 16963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:35.902738 16963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d"
format_stamp: "Formatted at 2026-08-07 15:24:35 on dist-test-slave-g170"
server_key: "6b2eabf1f7e54cd672f726c0b8b6221f"
server_key_iv: "03d9862e7fe98a3537fd1e30d08c4679"
server_key_version: "encryptionkey@0"
I20260807 15:24:35.903334 16963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d"
format_stamp: "Formatted at 2026-08-07 15:24:35 on dist-test-slave-g170"
server_key: "6b2eabf1f7e54cd672f726c0b8b6221f"
server_key_iv: "03d9862e7fe98a3537fd1e30d08c4679"
server_key_version: "encryptionkey@0"
I20260807 15:24:35.907362 16963 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 15:24:35.910038 16983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:35.911401 16963 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 15:24:35.911561 16963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d"
format_stamp: "Formatted at 2026-08-07 15:24:35 on dist-test-slave-g170"
server_key: "6b2eabf1f7e54cd672f726c0b8b6221f"
server_key_iv: "03d9862e7fe98a3537fd1e30d08c4679"
server_key_version: "encryptionkey@0"
I20260807 15:24:35.911680 16963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:35.916551 16963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:35.920029 16963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:35.920277 16963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:35.927716 16963 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45923
I20260807 15:24:35.927747 17067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45923 every 8 connection(s)
I20260807 15:24:35.928711 16963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:35.931846 17068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:35.937875 17068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d: Bootstrap starting.
I20260807 15:24:35.937959 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 16963
I20260807 15:24:35.938104 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:35.938457 16331 external_mini_cluster.cc:1428] Setting key 410481dbddcf66fc58dd0cea929c0835
I20260807 15:24:35.940872 17068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:35.941686 17068 log.cc:824] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:35.944087 17068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d: No bootstrap required, opened a new log
I20260807 15:24:35.944317 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:35.939966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:52703 (local address 127.0.0.1:45923)
0807 15:24:35.940458 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:35.940473 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:35.940510 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:24:35.941301 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:35.941322 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:35.941621 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:35.941997 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:35.942905 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:35.942910 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:35.942923 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:35.942934 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:35.942993 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:35.943012 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:35.943110 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:35.943258 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 15:24:35.943453 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":136,"threads_started":1}
I20260807 15:24:35.947435 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:35.948487 17068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45923 } }
I20260807 15:24:35.948781 17068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:35.948900 17068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55b47d6f67ae4ce8b6d4cca490ffc07d, State: Initialized, Role: FOLLOWER
I20260807 15:24:35.949497 17068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45923 } }
I20260807 15:24:35.949682 17068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:35.949771 17068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:35.949887 17068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:35.951233 17068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45923 } }
I20260807 15:24:35.951647 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:35.949730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.221:34729 (local address 127.0.0.1:45923)
0807 15:24:35.949872 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:35.949883 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:35.950117 (+ 234us) server_negotiation.cc:407] Connection header received
0807 15:24:35.950267 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:35.950269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:35.950301 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:35.950361 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:35.951175 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:35.951178 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:35.951180 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:35.951190 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:35.951215 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:35.951226 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:35.951298 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:35.951439 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 15:24:35.951490 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 15:24:35.951658 17068 leader_election.cc:302] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55b47d6f67ae4ce8b6d4cca490ffc07d; no voters:
I20260807 15:24:35.952101 17068 leader_election.cc:288] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:35.952205 17083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:35.952479 17083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [term 1 LEADER]: Becoming Leader. State: Replica: 55b47d6f67ae4ce8b6d4cca490ffc07d, State: Running, Role: LEADER
I20260807 15:24:35.952895 17083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45923 } }
I20260807 15:24:35.953590 17068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:35.954588 17085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45923 } } }
I20260807 15:24:35.954594 17084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55b47d6f67ae4ce8b6d4cca490ffc07d. Latest consensus state: current_term: 1 leader_uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55b47d6f67ae4ce8b6d4cca490ffc07d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45923 } } }
I20260807 15:24:35.954735 17085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:35.954792 17084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:35.955132 17095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:35.958760 17095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:35.964995 17095 catalog_manager.cc:1347] Generated new cluster ID: 49b64748a0184260a37934494b463af5
I20260807 15:24:35.965083 17095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:35.978739 17095 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:35.979117 17095 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:35.986013 17095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55b47d6f67ae4ce8b6d4cca490ffc07d: Generated new TSK 0
I20260807 15:24:35.986920 17095 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:35.996556 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 16963
2026-08-07T15:24:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1705 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:36 dist-test-slave-g170 krb5kdc[17115](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:36 dist-test-slave-g170 krb5kdc[17115](info): set up 2 sockets
Aug 07 15:24:36 dist-test-slave-g170 krb5kdc[17115](info): commencing operation
krb5kdc: starting...
W20260807 15:24:37.267050 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:37 dist-test-slave-g170 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:37.411026 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39067
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:44977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:39067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:37.531447 17132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:37.531767 17132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:37.531852 17132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:37.536012 17132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:37.536116 17132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:37.536151 17132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:37.536192 17132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:37.536223 17132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:37.541872 17132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:44977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:39067
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:39067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:37.543016 17132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:37.544080 17132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:37.552783 17151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:37.552801 17139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:37.552798 17144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:37.552918 17132 server_base.cc:1034] running on GCE node
I20260807 15:24:37.553646 17132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:37.554785 17132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:37.555964 17132 hybrid_clock.cc:648] HybridClock initialized: now 1786116277555936 us; error 41 us; skew 500 ppm
Aug 07 15:24:37 dist-test-slave-g170 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116277, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:37.559046 17132 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:37.559975 17132 webserver.cc:460] Webserver started at http://127.15.242.254:44417/ using document root <none> and password file <none>
I20260807 15:24:37.560554 17132 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:37.560650 17132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:37.560956 17132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:37.562983 17132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "59ab68d6e1734df0966e105d62c0e7ba"
format_stamp: "Formatted at 2026-08-07 15:24:37 on dist-test-slave-g170"
server_key: "0204eb1a64877af33f32b6e70ff1be47"
server_key_iv: "cb69ad8dc7a515ab750a8c57e6caeebd"
server_key_version: "encryptionkey@0"
I20260807 15:24:37.563566 17132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "59ab68d6e1734df0966e105d62c0e7ba"
format_stamp: "Formatted at 2026-08-07 15:24:37 on dist-test-slave-g170"
server_key: "0204eb1a64877af33f32b6e70ff1be47"
server_key_iv: "cb69ad8dc7a515ab750a8c57e6caeebd"
server_key_version: "encryptionkey@0"
I20260807 15:24:37.567461 17132 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:24:37.570153 17165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:37.571447 17132 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 15:24:37.571604 17132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "59ab68d6e1734df0966e105d62c0e7ba"
format_stamp: "Formatted at 2026-08-07 15:24:37 on dist-test-slave-g170"
server_key: "0204eb1a64877af33f32b6e70ff1be47"
server_key_iv: "cb69ad8dc7a515ab750a8c57e6caeebd"
server_key_version: "encryptionkey@0"
I20260807 15:24:37.571724 17132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:37.603111 17132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:37.606138 17132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:37.606351 17132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:37.614157 17132 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:39067
I20260807 15:24:37.614194 17246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:39067 every 8 connection(s)
I20260807 15:24:37.615103 17132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:37.617933 17248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:37.619966 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17132
I20260807 15:24:37.620139 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:37.620568 16331 external_mini_cluster.cc:1428] Setting key 282ec1304ead50d915189ccd25db946d
I20260807 15:24:37.624739 17248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba: Bootstrap starting.
I20260807 15:24:37.627346 17248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:37.628247 17248 log.cc:824] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:37.630407 17248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba: No bootstrap required, opened a new log
Aug 07 15:24:37 dist-test-slave-g170 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:37.634732 17248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab68d6e1734df0966e105d62c0e7ba" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39067 } }
I20260807 15:24:37.634948 17248 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:37.634980 17248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59ab68d6e1734df0966e105d62c0e7ba, State: Initialized, Role: FOLLOWER
I20260807 15:24:37.635545 17248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab68d6e1734df0966e105d62c0e7ba" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39067 } }
I20260807 15:24:37.635732 17248 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:37.635808 17248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:37.635908 17248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:37.637068 17248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab68d6e1734df0966e105d62c0e7ba" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39067 } }
I20260807 15:24:37.637434 17248 leader_election.cc:302] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59ab68d6e1734df0966e105d62c0e7ba; no voters:
I20260807 15:24:37.637754 17248 leader_election.cc:288] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:37.637894 17255 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:37.638046 17253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:37.622122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50079 (local address 127.15.242.254:39067)
0807 15:24:37.622589 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:37.622627 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:37.622672 (+ 45us) server_negotiation.cc:407] Connection header received
0807 15:24:37.623592 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:37.623616 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:37.624040 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:37.624412 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:37.625297 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:37.626773 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:37.627771 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:37.628480 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:37.628658 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:37.631592 (+ 2934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:37.631598 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:37.631614 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:37.631646 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:37.634501 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:37.635116 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:37.635123 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:37.635129 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:37.635269 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:37.635680 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:37.635684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:37.635686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:37.636223 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:37.636448 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:37.636791 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 15:24:37.637040 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":138,"threads_started":1}
I20260807 15:24:37.638176 17255 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [term 1 LEADER]: Becoming Leader. State: Replica: 59ab68d6e1734df0966e105d62c0e7ba, State: Running, Role: LEADER
I20260807 15:24:37.638725 17255 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab68d6e1734df0966e105d62c0e7ba" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39067 } }
I20260807 15:24:37.639075 17248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:37.640841 17256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59ab68d6e1734df0966e105d62c0e7ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab68d6e1734df0966e105d62c0e7ba" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39067 } } }
I20260807 15:24:37.640973 17256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:37.641805 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:37.642616 17257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59ab68d6e1734df0966e105d62c0e7ba. Latest consensus state: current_term: 1 leader_uuid: "59ab68d6e1734df0966e105d62c0e7ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab68d6e1734df0966e105d62c0e7ba" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 39067 } } }
I20260807 15:24:37.642791 17257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba [sys.catalog]: This master's current role is: LEADER
W20260807 15:24:37.644166 17277 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:37.644233 17277 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:37.644320 17275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:37.645502 17275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:37.650516 17275 catalog_manager.cc:1347] Generated new cluster ID: 5131880fd6374788a0b18b0d768ec9fd
I20260807 15:24:37.650574 17275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:37.654825 17253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:37.644733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41063 (local address 127.15.242.254:39067)
0807 15:24:37.644875 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:37.644882 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:37.645193 (+ 311us) server_negotiation.cc:407] Connection header received
0807 15:24:37.645426 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:37.645429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:37.645481 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:37.645587 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:37.646700 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:37.647592 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:37.648933 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:37.649295 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:37.649382 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:37.651290 (+ 1908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:37.651293 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:37.651296 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:37.651319 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:37.652967 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:37.653534 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:37.653537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:37.653539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:37.653617 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:37.653966 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:37.653969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:37.653971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:37.654153 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:37.654297 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:37.654592 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 15:24:37.654681 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":70}
I20260807 15:24:37.670131 17275 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:37.671386 17275 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:37.696211 17275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59ab68d6e1734df0966e105d62c0e7ba: Generated new TSK 0
I20260807 15:24:37.697250 17275 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:37.712530 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17132
W20260807 15:24:37.727563 17113 connection.cc:535] client connection to 127.15.242.254:39067 recv error: Network error: failed to read from TLS socket (remote: 127.15.242.254:39067): Connection reset by peer (error 104)
2026-08-07T15:24:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1703 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:37 dist-test-slave-g170 krb5kdc[17300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:37 dist-test-slave-g170 krb5kdc[17300](info): set up 2 sockets
Aug 07 15:24:37 dist-test-slave-g170 krb5kdc[17300](info): commencing operation
krb5kdc: starting...
W20260807 15:24:38.998543 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:39 dist-test-slave-g170 krb5kdc[17300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:39.145241 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38417
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:44473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:38417
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:39.274317 17318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:39.274576 17318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:39.274624 17318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:39.278602 17318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:39.278656 17318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:39.278676 17318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:39.278693 17318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:39.278708 17318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:39.284004 17318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:44473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:38417
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:38417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:39.285059 17318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:39.286067 17318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:39.295397 17329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:39.295404 17330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:39.295476 17318 server_base.cc:1034] running on GCE node
W20260807 15:24:39.295421 17333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:39.296310 17318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:39.297633 17318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:39.298856 17318 hybrid_clock.cc:648] HybridClock initialized: now 1786116279298804 us; error 66 us; skew 500 ppm
Aug 07 15:24:39 dist-test-slave-g170 krb5kdc[17300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116279, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:39.302130 17318 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:39.303157 17318 webserver.cc:460] Webserver started at http://127.15.242.254:40403/ using document root <none> and password file <none>
I20260807 15:24:39.303814 17318 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:39.303917 17318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:39.304194 17318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:39.306612 17318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "d51a59ea0ad84f8ea362908355c37683"
format_stamp: "Formatted at 2026-08-07 15:24:39 on dist-test-slave-g170"
server_key: "96a913e853fd651d3137f63d6aef7f6a"
server_key_iv: "afbcb1f2f9a0adc27c1415c08e0d4a1e"
server_key_version: "encryptionkey@0"
I20260807 15:24:39.307251 17318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "d51a59ea0ad84f8ea362908355c37683"
format_stamp: "Formatted at 2026-08-07 15:24:39 on dist-test-slave-g170"
server_key: "96a913e853fd651d3137f63d6aef7f6a"
server_key_iv: "afbcb1f2f9a0adc27c1415c08e0d4a1e"
server_key_version: "encryptionkey@0"
I20260807 15:24:39.311734 17318 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:24:39.314698 17344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:39.316126 17318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:24:39.316322 17318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "d51a59ea0ad84f8ea362908355c37683"
format_stamp: "Formatted at 2026-08-07 15:24:39 on dist-test-slave-g170"
server_key: "96a913e853fd651d3137f63d6aef7f6a"
server_key_iv: "afbcb1f2f9a0adc27c1415c08e0d4a1e"
server_key_version: "encryptionkey@0"
I20260807 15:24:39.316464 17318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:39.348392 17318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:39.352461 17318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:39.352718 17318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:39.361428 17318 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:38417
I20260807 15:24:39.361435 17424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:38417 every 8 connection(s)
I20260807 15:24:39.362571 17318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:39.364285 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17318
I20260807 15:24:39.364449 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:39.364820 16331 external_mini_cluster.cc:1428] Setting key bc8339c279d74f371b1ddc1740c55540
I20260807 15:24:39.366158 17425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:39.373030 17425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683: Bootstrap starting.
I20260807 15:24:39.374782 17428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:39.366433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34353 (local address 127.15.242.254:38417)
0807 15:24:39.366957 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:39.366973 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:39.367013 (+ 40us) server_negotiation.cc:407] Connection header received
0807 15:24:39.367703 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:39.367721 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:39.368066 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:39.368378 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:39.368839 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:39.369883 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:39.371153 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:39.371685 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:39.371815 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:39.372878 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:39.372884 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:39.372898 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:39.373385 (+ 487us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:39.373446 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:39.373472 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:39.373594 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:39.373776 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 15:24:39.373959 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":155,"threads_started":1}
I20260807 15:24:39.375542 17425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:39.376317 17425 log.cc:824] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:39.378000 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:39.378499 17425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683: No bootstrap required, opened a new log
I20260807 15:24:39.382927 17425 raft_consensus.cc:348] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d51a59ea0ad84f8ea362908355c37683" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38417 } }
I20260807 15:24:39.383214 17425 raft_consensus.cc:374] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:39.383322 17425 raft_consensus.cc:729] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51a59ea0ad84f8ea362908355c37683, State: Initialized, Role: FOLLOWER
I20260807 15:24:39.383813 17425 consensus_queue.cc:260] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d51a59ea0ad84f8ea362908355c37683" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38417 } }
I20260807 15:24:39.383966 17425 raft_consensus.cc:388] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:39.384053 17425 raft_consensus.cc:482] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:39.384156 17425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:39.384629 17428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:39.380126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44877 (local address 127.15.242.254:38417)
0807 15:24:39.380252 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:39.380255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:39.380496 (+ 241us) server_negotiation.cc:407] Connection header received
0807 15:24:39.380678 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:39.380681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:39.380733 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:39.380882 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:39.381220 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:39.381790 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:39.382932 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:39.383159 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:39.383295 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:39.384162 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:39.384166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:39.384169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:39.384188 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:39.384211 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:39.384221 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:39.384327 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:39.384449 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 15:24:39.384485 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:24:39.385327 17425 raft_consensus.cc:504] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d51a59ea0ad84f8ea362908355c37683" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38417 } }
I20260807 15:24:39.385746 17425 leader_election.cc:302] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d51a59ea0ad84f8ea362908355c37683; no voters:
I20260807 15:24:39.386102 17425 leader_election.cc:288] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:39.386257 17436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:39.386524 17436 raft_consensus.cc:686] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [term 1 LEADER]: Becoming Leader. State: Replica: d51a59ea0ad84f8ea362908355c37683, State: Running, Role: LEADER
I20260807 15:24:39.386927 17436 consensus_queue.cc:237] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d51a59ea0ad84f8ea362908355c37683" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38417 } }
I20260807 15:24:39.387493 17425 sys_catalog.cc:564] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:39.388792 17439 sys_catalog.cc:455] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d51a59ea0ad84f8ea362908355c37683" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d51a59ea0ad84f8ea362908355c37683" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38417 } } }
I20260807 15:24:39.388800 17440 sys_catalog.cc:455] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d51a59ea0ad84f8ea362908355c37683. Latest consensus state: current_term: 1 leader_uuid: "d51a59ea0ad84f8ea362908355c37683" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d51a59ea0ad84f8ea362908355c37683" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 38417 } } }
I20260807 15:24:39.388971 17440 sys_catalog.cc:458] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:39.388971 17439 sys_catalog.cc:458] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:39.389494 17453 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:39.392398 17453 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:39.398488 17453 catalog_manager.cc:1347] Generated new cluster ID: a91ad6843fe14743aa7d431ebc406fbe
I20260807 15:24:39.398558 17453 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:39.415809 17453 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:39.417145 17453 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:39.430989 17453 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d51a59ea0ad84f8ea362908355c37683: Generated new TSK 0
I20260807 15:24:39.431874 17453 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:39.441319 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17318
W20260807 15:24:39.454628 17294 connection.cc:535] client connection to 127.15.242.254:38417 recv error: Network error: failed to read from TLS socket (remote: 127.15.242.254:38417): Connection reset by peer (error 104)
2026-08-07T15:24:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1726 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:39 dist-test-slave-g170 krb5kdc[17472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:39 dist-test-slave-g170 krb5kdc[17472](info): set up 2 sockets
Aug 07 15:24:39 dist-test-slave-g170 krb5kdc[17472](info): commencing operation
krb5kdc: starting...
W20260807 15:24:40.714335 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:40 dist-test-slave-g170 krb5kdc[17472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116280, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:40.857416 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45037
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:34377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:45037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:40.980155 17495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:40.980441 17495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:40.980484 17495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:40.984547 17495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:40.984624 17495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:40.984647 17495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:40.984663 17495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:40.984678 17495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:40.990295 17495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:34377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:45037
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:40.991418 17495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:40.992516 17495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:41.001842 17501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:41.001883 17503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:41.001947 17495 server_base.cc:1034] running on GCE node
W20260807 15:24:41.002071 17506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:41.002777 17495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:41.003938 17495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:41.005101 17495 hybrid_clock.cc:648] HybridClock initialized: now 1786116281005083 us; error 33 us; skew 500 ppm
Aug 07 15:24:41 dist-test-slave-g170 krb5kdc[17472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116281, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:41.013705 17495 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:41.014818 17495 webserver.cc:460] Webserver started at http://127.15.242.254:36717/ using document root <none> and password file <none>
I20260807 15:24:41.015445 17495 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:41.015511 17495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:41.015776 17495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:41.018091 17495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "578f63c9aba140b6ba64406f66204657"
format_stamp: "Formatted at 2026-08-07 15:24:41 on dist-test-slave-g170"
server_key: "3d89aea3ea1989d8bf2e32413c6d6387"
server_key_iv: "20aa959ef4d8011df76d18df222aaa6c"
server_key_version: "encryptionkey@0"
I20260807 15:24:41.018683 17495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "578f63c9aba140b6ba64406f66204657"
format_stamp: "Formatted at 2026-08-07 15:24:41 on dist-test-slave-g170"
server_key: "3d89aea3ea1989d8bf2e32413c6d6387"
server_key_iv: "20aa959ef4d8011df76d18df222aaa6c"
server_key_version: "encryptionkey@0"
I20260807 15:24:41.022831 17495 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:41.025642 17516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:41.027304 17495 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:24:41.027489 17495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "578f63c9aba140b6ba64406f66204657"
format_stamp: "Formatted at 2026-08-07 15:24:41 on dist-test-slave-g170"
server_key: "3d89aea3ea1989d8bf2e32413c6d6387"
server_key_iv: "20aa959ef4d8011df76d18df222aaa6c"
server_key_version: "encryptionkey@0"
I20260807 15:24:41.027626 17495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:41.033216 17495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:41.036779 17495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:41.036998 17495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:41.045400 17495 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:45037
I20260807 15:24:41.045432 17588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:45037 every 8 connection(s)
I20260807 15:24:41.046461 17495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:41.046758 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17495
I20260807 15:24:41.046941 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:41.047312 16331 external_mini_cluster.cc:1428] Setting key 17a38489c033a3f29504186b164749ad
I20260807 15:24:41.050007 17590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:41.053207 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:41.048914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49901 (local address 127.15.242.254:45037)
0807 15:24:41.049400 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:41.049417 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:41.049457 (+ 40us) server_negotiation.cc:407] Connection header received
0807 15:24:41.050243 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:41.050264 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:41.050571 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:41.050971 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:41.051855 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:41.051860 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:41.051874 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:41.051885 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:41.051941 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:41.051961 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:41.052153 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:41.052233 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 15:24:41.052406 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":162,"threads_started":1}
I20260807 15:24:41.056267 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:41.056676 17590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657: Bootstrap starting.
I20260807 15:24:41.059336 17590 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:41.060442 17590 log.cc:824] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:41.060611 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:41.058574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50707 (local address 127.15.242.254:45037)
0807 15:24:41.058719 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:41.058724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:41.058928 (+ 204us) server_negotiation.cc:407] Connection header received
0807 15:24:41.059064 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:41.059066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:41.059097 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:41.059168 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:41.060058 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:41.060061 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:41.060063 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:41.060075 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:41.060103 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:41.060113 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:41.060204 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:41.060368 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 15:24:41.060402 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 15:24:41.062505 17590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657: No bootstrap required, opened a new log
I20260807 15:24:41.066660 17590 raft_consensus.cc:348] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578f63c9aba140b6ba64406f66204657" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45037 } }
I20260807 15:24:41.066915 17590 raft_consensus.cc:374] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:41.067005 17590 raft_consensus.cc:729] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 578f63c9aba140b6ba64406f66204657, State: Initialized, Role: FOLLOWER
I20260807 15:24:41.067559 17590 consensus_queue.cc:260] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578f63c9aba140b6ba64406f66204657" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45037 } }
I20260807 15:24:41.067714 17590 raft_consensus.cc:388] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:41.067766 17590 raft_consensus.cc:482] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:41.067843 17590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:41.068871 17590 raft_consensus.cc:504] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578f63c9aba140b6ba64406f66204657" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45037 } }
I20260807 15:24:41.069188 17590 leader_election.cc:302] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 578f63c9aba140b6ba64406f66204657; no voters:
I20260807 15:24:41.069504 17590 leader_election.cc:288] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:41.069603 17604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:41.069859 17604 raft_consensus.cc:686] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [term 1 LEADER]: Becoming Leader. State: Replica: 578f63c9aba140b6ba64406f66204657, State: Running, Role: LEADER
I20260807 15:24:41.070199 17604 consensus_queue.cc:237] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578f63c9aba140b6ba64406f66204657" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45037 } }
I20260807 15:24:41.070808 17590 sys_catalog.cc:564] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:41.071951 17607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 578f63c9aba140b6ba64406f66204657. Latest consensus state: current_term: 1 leader_uuid: "578f63c9aba140b6ba64406f66204657" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578f63c9aba140b6ba64406f66204657" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45037 } } }
I20260807 15:24:41.072093 17607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:41.072422 17605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "578f63c9aba140b6ba64406f66204657" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578f63c9aba140b6ba64406f66204657" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45037 } } }
I20260807 15:24:41.072518 17605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:41.072522 17620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:41.075660 17620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:41.081532 17620 catalog_manager.cc:1347] Generated new cluster ID: f767e08ea2aa4279a8c27945dec70767
I20260807 15:24:41.081600 17620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:41.103067 17620 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:41.103538 17620 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:41.113493 17620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 578f63c9aba140b6ba64406f66204657: Generated new TSK 0
I20260807 15:24:41.114259 17620 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:41.121070 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17495
2026-08-07T15:24:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1684 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:41 dist-test-slave-g170 krb5kdc[17635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:41 dist-test-slave-g170 krb5kdc[17635](info): set up 2 sockets
Aug 07 15:24:41 dist-test-slave-g170 krb5kdc[17635](info): commencing operation
krb5kdc: starting...
W20260807 15:24:42.435047 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:42 dist-test-slave-g170 krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:42.576463 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:35835
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:35835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:42.690538 17654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:42.690853 17654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:42.690929 17654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:42.694957 17654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:42.695042 17654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:42.695077 17654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:42.695119 17654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:42.695159 17654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:42.700677 17654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:35835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:35835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:42.702016 17654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:42.703189 17654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:42.712404 17671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:42.712397 17664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:42.712397 17668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:42.712827 17654 server_base.cc:1034] running on GCE node
I20260807 15:24:42.713449 17654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:42.714592 17654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:42.715793 17654 hybrid_clock.cc:648] HybridClock initialized: now 1786116282715758 us; error 51 us; skew 500 ppm
Aug 07 15:24:42 dist-test-slave-g170 krb5kdc[17635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116282, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:42.718732 17654 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:42.719601 17654 webserver.cc:460] Webserver started at http://127.15.242.254:44043/ using document root <none> and password file <none>
I20260807 15:24:42.720269 17654 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:42.720366 17654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:42.720613 17654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:42.722715 17654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "744e0a8ae5d54b82b320628a7224c7b4"
format_stamp: "Formatted at 2026-08-07 15:24:42 on dist-test-slave-g170"
server_key: "dbeb2c0c9f2ef81dbc6b948a06436393"
server_key_iv: "09c72cb8967a3897d420564de83895dd"
server_key_version: "encryptionkey@0"
I20260807 15:24:42.723361 17654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "744e0a8ae5d54b82b320628a7224c7b4"
format_stamp: "Formatted at 2026-08-07 15:24:42 on dist-test-slave-g170"
server_key: "dbeb2c0c9f2ef81dbc6b948a06436393"
server_key_iv: "09c72cb8967a3897d420564de83895dd"
server_key_version: "encryptionkey@0"
I20260807 15:24:42.727239 17654 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:42.729904 17681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:42.731293 17654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:42.731454 17654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "744e0a8ae5d54b82b320628a7224c7b4"
format_stamp: "Formatted at 2026-08-07 15:24:42 on dist-test-slave-g170"
server_key: "dbeb2c0c9f2ef81dbc6b948a06436393"
server_key_iv: "09c72cb8967a3897d420564de83895dd"
server_key_version: "encryptionkey@0"
I20260807 15:24:42.731573 17654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:42.758934 17654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:42.762645 17654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:42.762876 17654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:42.772066 17654 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:35835
I20260807 15:24:42.772114 17755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:35835 every 8 connection(s)
I20260807 15:24:42.773586 17654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:42.774333 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17654
I20260807 15:24:42.774520 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:42.774993 16331 external_mini_cluster.cc:1428] Setting key f1c10626b504d2379641bea02c6949b9
I20260807 15:24:42.777278 17756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:42.785221 17756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4: Bootstrap starting.
I20260807 15:24:42.788383 17756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4: Neither blocks nor log segments found. Creating new log.
Aug 07 15:24:42 dist-test-slave-g170 krb5kdc[17635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:42.789505 17756 log.cc:824] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:42.792052 17756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4: No bootstrap required, opened a new log
I20260807 15:24:42.795341 17762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:42.778840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35135 (local address 127.15.242.254:35835)
0807 15:24:42.779317 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:42.779337 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:42.779385 (+ 48us) server_negotiation.cc:407] Connection header received
0807 15:24:42.780840 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:42.780870 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:42.781388 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:42.781842 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:42.783463 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:42.784590 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:42.785878 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:42.786422 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:42.786555 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:42.790024 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:42.790033 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:42.790053 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:42.790117 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:42.792065 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:42.792664 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:42.792669 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:42.792675 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:42.792897 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:42.793258 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:42.793260 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:42.793261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:42.793677 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:42.793838 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:42.794174 (+ 336us) server_negotiation.cc:299] Negotiation successful
0807 15:24:42.794549 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":126,"threads_started":1}
I20260807 15:24:42.797003 17756 raft_consensus.cc:348] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744e0a8ae5d54b82b320628a7224c7b4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35835 } }
I20260807 15:24:42.797245 17756 raft_consensus.cc:374] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:42.797322 17756 raft_consensus.cc:729] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 744e0a8ae5d54b82b320628a7224c7b4, State: Initialized, Role: FOLLOWER
I20260807 15:24:42.797914 17756 consensus_queue.cc:260] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744e0a8ae5d54b82b320628a7224c7b4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35835 } }
I20260807 15:24:42.798058 17756 raft_consensus.cc:388] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:42.798147 17756 raft_consensus.cc:482] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:42.798257 17756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:42.798967 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:42.799475 17756 raft_consensus.cc:504] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744e0a8ae5d54b82b320628a7224c7b4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35835 } }
I20260807 15:24:42.799849 17756 leader_election.cc:302] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 744e0a8ae5d54b82b320628a7224c7b4; no voters:
I20260807 15:24:42.800244 17756 leader_election.cc:288] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:42.800330 17770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:42.800561 17770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [term 1 LEADER]: Becoming Leader. State: Replica: 744e0a8ae5d54b82b320628a7224c7b4, State: Running, Role: LEADER
I20260807 15:24:42.800945 17770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744e0a8ae5d54b82b320628a7224c7b4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35835 } }
I20260807 15:24:42.801743 17756 sys_catalog.cc:564] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:42.802881 17776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "744e0a8ae5d54b82b320628a7224c7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744e0a8ae5d54b82b320628a7224c7b4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35835 } } }
I20260807 15:24:42.803035 17776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:42.803369 17777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 744e0a8ae5d54b82b320628a7224c7b4. Latest consensus state: current_term: 1 leader_uuid: "744e0a8ae5d54b82b320628a7224c7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "744e0a8ae5d54b82b320628a7224c7b4" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 35835 } } }
I20260807 15:24:42.803473 17777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:42.803591 17791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:42.807224 17791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:42.814170 17791 catalog_manager.cc:1347] Generated new cluster ID: 8fc0e163b07540348437d730561b1ad3
I20260807 15:24:42.814272 17791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:42.815274 17762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:42.801623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45277 (local address 127.15.242.254:35835)
0807 15:24:42.801762 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:42.801768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:42.803853 (+ 2085us) server_negotiation.cc:407] Connection header received
0807 15:24:42.804143 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:42.804150 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:42.804215 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:42.804340 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:42.805350 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:42.806247 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:42.807149 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:42.807558 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:42.807703 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:42.809352 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:42.809357 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:42.809360 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:42.809419 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:42.813045 (+ 3626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:42.813526 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:42.813531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:42.813533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:42.813627 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:42.814143 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:42.814147 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:42.814149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:42.814460 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:42.814623 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:42.814967 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 15:24:42.815113 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 15:24:42.830245 17791 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:42.831655 17791 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:42.838886 17791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 744e0a8ae5d54b82b320628a7224c7b4: Generated new TSK 0
I20260807 15:24:42.839697 17791 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:42.846918 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17654
2026-08-07T15:24:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1721 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:42 dist-test-slave-g170 krb5kdc[17806](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:42 dist-test-slave-g170 krb5kdc[17806](info): set up 2 sockets
Aug 07 15:24:42 dist-test-slave-g170 krb5kdc[17806](info): commencing operation
krb5kdc: starting...
W20260807 15:24:44.169317 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:44 dist-test-slave-g170 krb5kdc[17806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:44.312096 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:37173
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:37173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:44.431886 17834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:44.432225 17834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:44.432313 17834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:44.436324 17834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:44.436432 17834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:44.436472 17834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:44.436512 17834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:44.436546 17834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:44.442209 17834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:37173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:37173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:44.443365 17834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:44.444453 17834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:44.453576 17849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:44.453655 17844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:44.453750 17843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:44.454335 17834 server_base.cc:1034] running on GCE node
I20260807 15:24:44.454986 17834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:44.456375 17834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:44.457592 17834 hybrid_clock.cc:648] HybridClock initialized: now 1786116284457540 us; error 74 us; skew 500 ppm
Aug 07 15:24:44 dist-test-slave-g170 krb5kdc[17806](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116284, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:44.460567 17834 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:44.461522 17834 webserver.cc:460] Webserver started at http://127.15.242.254:35841/ using document root <none> and password file <none>
I20260807 15:24:44.462105 17834 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:44.462200 17834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:44.462443 17834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:44.464514 17834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "d7098240074d4bb9b2a5684cb86859f3"
format_stamp: "Formatted at 2026-08-07 15:24:44 on dist-test-slave-g170"
server_key: "f8679ff0ce1a3883770edb67b5e41b79"
server_key_iv: "6a2652a1b23f39166fd9d6bfaf2e0c72"
server_key_version: "encryptionkey@0"
I20260807 15:24:44.465106 17834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "d7098240074d4bb9b2a5684cb86859f3"
format_stamp: "Formatted at 2026-08-07 15:24:44 on dist-test-slave-g170"
server_key: "f8679ff0ce1a3883770edb67b5e41b79"
server_key_iv: "6a2652a1b23f39166fd9d6bfaf2e0c72"
server_key_version: "encryptionkey@0"
I20260807 15:24:44.468976 17834 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:24:44.471451 17857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:44.472846 17834 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 15:24:44.472986 17834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "d7098240074d4bb9b2a5684cb86859f3"
format_stamp: "Formatted at 2026-08-07 15:24:44 on dist-test-slave-g170"
server_key: "f8679ff0ce1a3883770edb67b5e41b79"
server_key_iv: "6a2652a1b23f39166fd9d6bfaf2e0c72"
server_key_version: "encryptionkey@0"
I20260807 15:24:44.473100 17834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:44.490703 17834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:44.494720 17834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:44.494988 17834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:44.502987 17834 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:37173
I20260807 15:24:44.503013 17940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:37173 every 8 connection(s)
I20260807 15:24:44.504011 17834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:44.507017 17943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:44.510283 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 17834
I20260807 15:24:44.510459 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:44.510788 16331 external_mini_cluster.cc:1428] Setting key d24db5dae43012a95d24f14d9fce3153
I20260807 15:24:44.513587 17943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3: Bootstrap starting.
I20260807 15:24:44.515920 17943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:44.516705 17943 log.cc:824] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:44.518846 17943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3: No bootstrap required, opened a new log
I20260807 15:24:44.521360 17947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:44.512320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41347 (local address 127.15.242.254:37173)
0807 15:24:44.512959 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:44.512982 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:44.513021 (+ 39us) server_negotiation.cc:407] Connection header received
0807 15:24:44.513695 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:44.513724 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:44.514310 (+ 586us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:44.514726 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:44.515201 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:44.516433 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:44.517579 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:44.518116 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:44.518335 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:44.519357 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:44.519363 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:44.519378 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:44.519814 (+ 436us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:44.519875 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:44.519901 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:44.520041 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:44.520209 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 15:24:44.520439 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":131,"threads_started":1}
I20260807 15:24:44.522790 17943 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7098240074d4bb9b2a5684cb86859f3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37173 } }
I20260807 15:24:44.523072 17943 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:44.523123 17943 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7098240074d4bb9b2a5684cb86859f3, State: Initialized, Role: FOLLOWER
I20260807 15:24:44.523587 17943 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7098240074d4bb9b2a5684cb86859f3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37173 } }
I20260807 15:24:44.523728 17943 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:44.523823 17943 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:44.523947 17943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:44.524638 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:44.525101 17943 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7098240074d4bb9b2a5684cb86859f3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37173 } }
I20260807 15:24:44.525447 17943 leader_election.cc:302] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7098240074d4bb9b2a5684cb86859f3; no voters:
I20260807 15:24:44.525812 17943 leader_election.cc:288] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:44.525889 17950 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:44.526119 17950 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [term 1 LEADER]: Becoming Leader. State: Replica: d7098240074d4bb9b2a5684cb86859f3, State: Running, Role: LEADER
I20260807 15:24:44.526527 17950 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7098240074d4bb9b2a5684cb86859f3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37173 } }
I20260807 15:24:44.527225 17943 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:44.528625 17951 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7098240074d4bb9b2a5684cb86859f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7098240074d4bb9b2a5684cb86859f3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37173 } } }
I20260807 15:24:44.528821 17951 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:44.528643 17952 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7098240074d4bb9b2a5684cb86859f3. Latest consensus state: current_term: 1 leader_uuid: "d7098240074d4bb9b2a5684cb86859f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7098240074d4bb9b2a5684cb86859f3" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37173 } } }
I20260807 15:24:44.529131 17952 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3 [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:44.529279 17971 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:44.533272 17971 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:44.534978 17947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:44.528553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33245 (local address 127.15.242.254:37173)
0807 15:24:44.528666 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:44.528670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:44.530319 (+ 1649us) server_negotiation.cc:407] Connection header received
0807 15:24:44.530498 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:44.530503 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:44.530564 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:44.530685 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:44.530980 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:44.531841 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:44.533149 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:44.533445 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:44.533574 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:44.534523 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:44.534527 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:44.534529 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:44.534543 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:44.534579 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:44.534590 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:44.534671 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:44.534769 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 15:24:44.534824 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 15:24:44.539803 17971 catalog_manager.cc:1347] Generated new cluster ID: e633e767e7c44eddbbc07e2cf6c610cb
I20260807 15:24:44.539902 17971 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:44.547534 17971 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:44.548712 17971 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:44.558840 17971 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7098240074d4bb9b2a5684cb86859f3: Generated new TSK 0
I20260807 15:24:44.559729 17971 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:44.572669 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 17834
2026-08-07T15:24:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1728 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:44 dist-test-slave-g170 krb5kdc[17990](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:44 dist-test-slave-g170 krb5kdc[17990](info): set up 2 sockets
Aug 07 15:24:44 dist-test-slave-g170 krb5kdc[17990](info): commencing operation
krb5kdc: starting...
W20260807 15:24:45.863101 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:45 dist-test-slave-g170 krb5kdc[17990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:46.004278 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:43955
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:38457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:43955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:46.126238 18005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:46.126560 18005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:46.126636 18005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:46.130973 18005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:46.131044 18005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:46.131064 18005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:46.131081 18005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:46.131134 18005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:46.136986 18005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:38457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:43955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:43955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:46.138236 18005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:46.139405 18005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:46.149096 18011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:46.149187 18005 server_base.cc:1034] running on GCE node
W20260807 15:24:46.149129 18016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:46.149096 18013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:46.150087 18005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:46.151417 18005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:46.152621 18005 hybrid_clock.cc:648] HybridClock initialized: now 1786116286152568 us; error 61 us; skew 500 ppm
Aug 07 15:24:46 dist-test-slave-g170 krb5kdc[17990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116286, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:46.159368 18005 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:46.160454 18005 webserver.cc:460] Webserver started at http://127.15.242.254:35419/ using document root <none> and password file <none>
I20260807 15:24:46.161216 18005 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:46.161324 18005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:46.161584 18005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:46.163789 18005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "bda9d985013142b6b182e5088e27f9dc"
format_stamp: "Formatted at 2026-08-07 15:24:46 on dist-test-slave-g170"
server_key: "e0d3b7569270e21fd38df0f9b93d48b4"
server_key_iv: "4588c7e8f51b23a232ef9f21ff82bd72"
server_key_version: "encryptionkey@0"
I20260807 15:24:46.164420 18005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "bda9d985013142b6b182e5088e27f9dc"
format_stamp: "Formatted at 2026-08-07 15:24:46 on dist-test-slave-g170"
server_key: "e0d3b7569270e21fd38df0f9b93d48b4"
server_key_iv: "4588c7e8f51b23a232ef9f21ff82bd72"
server_key_version: "encryptionkey@0"
I20260807 15:24:46.169030 18005 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 15:24:46.171849 18023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:46.173332 18005 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:46.173492 18005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "bda9d985013142b6b182e5088e27f9dc"
format_stamp: "Formatted at 2026-08-07 15:24:46 on dist-test-slave-g170"
server_key: "e0d3b7569270e21fd38df0f9b93d48b4"
server_key_iv: "4588c7e8f51b23a232ef9f21ff82bd72"
server_key_version: "encryptionkey@0"
I20260807 15:24:46.173623 18005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:46.178784 18005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:46.182044 18005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:46.182268 18005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:46.190404 18005 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:43955
I20260807 15:24:46.190412 18099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:43955 every 8 connection(s)
I20260807 15:24:46.191459 18005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:46.192667 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18005
I20260807 15:24:46.192881 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:46.193213 16331 external_mini_cluster.cc:1428] Setting key caf99d7cb85ac835f9a7dad39317629e
I20260807 15:24:46.195051 18100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:46.198948 18104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:46.194736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60619 (local address 127.15.242.254:43955)
0807 15:24:46.195293 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:46.195312 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:46.195355 (+ 43us) server_negotiation.cc:407] Connection header received
0807 15:24:46.196073 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:46.196092 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:46.196430 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:46.196833 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:46.197690 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:46.197695 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:46.197708 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:46.197719 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:46.197774 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:46.197794 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:46.197962 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:46.198041 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 15:24:46.198215 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":141,"threads_started":1}
I20260807 15:24:46.201303 18100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc: Bootstrap starting.
I20260807 15:24:46.202193 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:46.203851 18100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:46.204780 18100 log.cc:824] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:46.206630 18104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:46.204566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40353 (local address 127.15.242.254:43955)
0807 15:24:46.204722 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:46.204726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:46.205052 (+ 326us) server_negotiation.cc:407] Connection header received
0807 15:24:46.205179 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:46.205185 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:46.205227 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:46.205313 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:46.206158 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:46.206161 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:46.206164 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 15:24:46.206176 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:46.206202 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 15:24:46.206216 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:46.206307 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:46.206455 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 15:24:46.206493 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 15:24:46.207259 18100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc: No bootstrap required, opened a new log
I20260807 15:24:46.211167 18100 raft_consensus.cc:348] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda9d985013142b6b182e5088e27f9dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43955 } }
I20260807 15:24:46.211395 18100 raft_consensus.cc:374] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 15:24:46.211473 18100 raft_consensus.cc:729] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda9d985013142b6b182e5088e27f9dc, State: Initialized, Role: FOLLOWER
I20260807 15:24:46.211915 18100 consensus_queue.cc:260] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda9d985013142b6b182e5088e27f9dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43955 } }
I20260807 15:24:46.212069 18100 raft_consensus.cc:388] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 15:24:46.212160 18100 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 15:24:46.212292 18100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:46.213310 18100 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda9d985013142b6b182e5088e27f9dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43955 } }
I20260807 15:24:46.213661 18100 leader_election.cc:302] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bda9d985013142b6b182e5088e27f9dc; no voters:
I20260807 15:24:46.213980 18100 leader_election.cc:288] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 15:24:46.214128 18114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:46.214392 18114 raft_consensus.cc:686] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [term 1 LEADER]: Becoming Leader. State: Replica: bda9d985013142b6b182e5088e27f9dc, State: Running, Role: LEADER
I20260807 15:24:46.214797 18114 consensus_queue.cc:237] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda9d985013142b6b182e5088e27f9dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43955 } }
I20260807 15:24:46.215322 18100 sys_catalog.cc:564] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:46.216809 18117 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader bda9d985013142b6b182e5088e27f9dc. Latest consensus state: current_term: 1 leader_uuid: "bda9d985013142b6b182e5088e27f9dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda9d985013142b6b182e5088e27f9dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43955 } } }
I20260807 15:24:46.216815 18116 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bda9d985013142b6b182e5088e27f9dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda9d985013142b6b182e5088e27f9dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 43955 } } }
I20260807 15:24:46.217024 18117 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:46.217027 18116 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc [sys.catalog]: This master's current role is: LEADER
W20260807 15:24:46.220403 18142 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:46.220474 18142 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:46.220558 18135 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:46.221333 18135 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:46.227140 18135 catalog_manager.cc:1347] Generated new cluster ID: f580154edee74186a1ed30b23e652bfc
I20260807 15:24:46.227252 18135 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:46.244244 18135 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:46.244607 18135 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:46.250190 18135 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bda9d985013142b6b182e5088e27f9dc: Generated new TSK 0
I20260807 15:24:46.251070 18135 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 15:24:46.266957 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18005
2026-08-07T15:24:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1691 ms)
[----------] 18 tests from AuthTokenIssuingTest (30918 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:46 dist-test-slave-g170 krb5kdc[18153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:46 dist-test-slave-g170 krb5kdc[18153](info): set up 2 sockets
Aug 07 15:24:46 dist-test-slave-g170 krb5kdc[18153](info): commencing operation
krb5kdc: starting...
W20260807 15:24:47.525866 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:47 dist-test-slave-g170 krb5kdc[18153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:47.664245 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45555
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:45555,127.15.242.253:36467,127.15.242.252:34437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:47.781603 18175 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 15:24:47.781977 18175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:47.782094 18175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:47.782186 18175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:47.789683 18175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:47.789840 18175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:47.789920 18175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:47.789991 18175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:47.790055 18175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:47.797233 18175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:45555,127.15.242.253:36467,127.15.242.252:34437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:45555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:47.798353 18175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:47.799383 18175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:47.808357 18181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:47.808394 18182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:47.808482 18175 server_base.cc:1034] running on GCE node
W20260807 15:24:47.808357 18189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:47.809407 18175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:47.810460 18175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:47.811707 18175 hybrid_clock.cc:648] HybridClock initialized: now 1786116287811692 us; error 27 us; skew 500 ppm
Aug 07 15:24:47 dist-test-slave-g170 krb5kdc[18153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116287, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:47.814772 18175 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:47.815673 18175 webserver.cc:460] Webserver started at http://127.15.242.254:45515/ using document root <none> and password file <none>
I20260807 15:24:47.816254 18175 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:47.816346 18175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:47.816584 18175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:47.818755 18175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "e3d65ba4caee41eb87cdafd68bc9016f"
format_stamp: "Formatted at 2026-08-07 15:24:47 on dist-test-slave-g170"
server_key: "d2ffa9badc9acbb84f30e26ad2aaf2eb"
server_key_iv: "a76cf7602eb48f92894715d62bfba690"
server_key_version: "encryptionkey@0"
I20260807 15:24:47.819342 18175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "e3d65ba4caee41eb87cdafd68bc9016f"
format_stamp: "Formatted at 2026-08-07 15:24:47 on dist-test-slave-g170"
server_key: "d2ffa9badc9acbb84f30e26ad2aaf2eb"
server_key_iv: "a76cf7602eb48f92894715d62bfba690"
server_key_version: "encryptionkey@0"
I20260807 15:24:47.823285 18175 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 15:24:47.825968 18197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:47.827378 18175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:47.827708 18175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "e3d65ba4caee41eb87cdafd68bc9016f"
format_stamp: "Formatted at 2026-08-07 15:24:47 on dist-test-slave-g170"
server_key: "d2ffa9badc9acbb84f30e26ad2aaf2eb"
server_key_iv: "a76cf7602eb48f92894715d62bfba690"
server_key_version: "encryptionkey@0"
I20260807 15:24:47.827847 18175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:47.848213 18175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:47.852074 18175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:47.852327 18175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:47.860329 18175 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:45555
I20260807 15:24:47.860618 18276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:45555 every 8 connection(s)
I20260807 15:24:47.861474 18175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:47.862826 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18175
I20260807 15:24:47.862965 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:47.863300 16331 external_mini_cluster.cc:1428] Setting key f8d58390f6b0e192651ac840f880d8c1
I20260807 15:24:47.865094 18277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:47.869366 18277 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.242.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.253@KRBTEST.COM" created.
Aug 07 15:24:47 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116287, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:47.888134 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:47.872504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45555 (local address 127.0.0.1:56670)
0807 15:24:47.873176 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:47.873252 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:47.874164 (+ 912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:47.874973 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:47.874985 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:47.875416 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:47.875674 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:47.875688 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:47.877306 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:47.877313 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:47.878633 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:47.878644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:47.879336 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:47.879341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:47.879432 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:47.880133 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:47.880160 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:47.882191 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:47.884691 (+ 2500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:47.884702 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:47.884714 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:47.885030 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:47.885396 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:47.885400 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:47.885402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:47.885532 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:47.886192 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:47.886199 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:47.886354 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 15:24:47.886529 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 15:24:47.887035 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":172,"thread_start_us":194,"threads_started":1}
I20260807 15:24:47.888134 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:47.872504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56670 (local address 127.15.242.254:45555)
0807 15:24:47.873183 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:47.873205 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:47.873382 (+ 177us) server_negotiation.cc:407] Connection header received
0807 15:24:47.874492 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:47.874497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:47.874697 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:47.874906 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:47.876003 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:47.877165 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:47.878764 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:47.879149 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:47.879353 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:47.882380 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:47.882387 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:47.882400 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:47.882425 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:47.884535 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:47.885152 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:47.885158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:47.885160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:47.885275 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:47.885637 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:47.885640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:47.885646 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:47.886063 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:47.886213 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:47.886647 (+ 434us) server_negotiation.cc:299] Negotiation successful
0807 15:24:47.886981 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":543,"spinlock_wait_cycles":47488,"thread_start_us":220,"threads_started":1}
I20260807 15:24:47.890888 18277 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:47.891875 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:47.891507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34866)
0807 15:24:47.891714 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:47.891800 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 15:24:47.892139 18201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
I20260807 15:24:47.893268 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:47.892964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34882)
0807 15:24:47.893128 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:47.893183 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260807 15:24:47.893455 18277 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:36467: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab.
Entry for principal kudu/127.15.242.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab.
I20260807 15:24:47.897063 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.253:36467
--webserver_interface=127.15.242.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab
--principal=kudu/127.15.242.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:45555,127.15.242.253:36467,127.15.242.252:34437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:24:47.942798 18277 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } attempt: 1
I20260807 15:24:47.943807 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:47.943463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34892)
0807 15:24:47.943631 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:47.943711 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 15:24:47.944680 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:47.944433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34896)
0807 15:24:47.944556 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:47.944612 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 15:24:47.944906 18277 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:36467: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
I20260807 15:24:48.013125 18277 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } attempt: 2
I20260807 15:24:48.014189 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.013718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34912)
0807 15:24:48.013995 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.014097 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260807 15:24:48.014971 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.014737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34914)
0807 15:24:48.014871 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.014916 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 15:24:48.015152 18277 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:36467: Network error: Client connection negotiation failed: client connection to 127.15.242.253:36467: connect: Connection refused (error 111)
W20260807 15:24:48.018682 18290 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 15:24:48.019078 18290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:48.019140 18290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:48.019232 18290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:48.023451 18290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:48.023532 18290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:48.023578 18290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:48.023631 18290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:48.023669 18290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:48.029206 18290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:45555,127.15.242.253:36467,127.15.242.252:34437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab
--principal=kudu/127.15.242.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.253:36467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.242.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:48.030328 18290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:48.031486 18290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:48.040361 18295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:48.040414 18290 server_base.cc:1034] running on GCE node
W20260807 15:24:48.040432 18311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:48.040373 18296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:48.041232 18290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:48.042377 18290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:48.043586 18290 hybrid_clock.cc:648] HybridClock initialized: now 1786116288043563 us; error 33 us; skew 500 ppm
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116288, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:48.046764 18290 init.cc:377] Logged in from keytab as kudu/127.15.242.253@KRBTEST.COM (short username kudu)
I20260807 15:24:48.047930 18290 webserver.cc:460] Webserver started at http://127.15.242.253:33211/ using document root <none> and password file <none>
I20260807 15:24:48.048640 18290 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:48.048734 18290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:48.049008 18290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:48.051111 18290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/data/instance:
uuid: "954a1335fb164843a9c7cc5b81f9acf7"
format_stamp: "Formatted at 2026-08-07 15:24:48 on dist-test-slave-g170"
server_key: "7c2b8ae4560a7acc3d083726118abd4b"
server_key_iv: "8544d41d3804a8299b023fe279b154a0"
server_key_version: "encryptionkey@0"
I20260807 15:24:48.051684 18290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/wal/instance:
uuid: "954a1335fb164843a9c7cc5b81f9acf7"
format_stamp: "Formatted at 2026-08-07 15:24:48 on dist-test-slave-g170"
server_key: "7c2b8ae4560a7acc3d083726118abd4b"
server_key_iv: "8544d41d3804a8299b023fe279b154a0"
server_key_version: "encryptionkey@0"
I20260807 15:24:48.055630 18290 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 15:24:48.058341 18321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:48.059559 18290 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 15:24:48.059702 18290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/wal
uuid: "954a1335fb164843a9c7cc5b81f9acf7"
format_stamp: "Formatted at 2026-08-07 15:24:48 on dist-test-slave-g170"
server_key: "7c2b8ae4560a7acc3d083726118abd4b"
server_key_iv: "8544d41d3804a8299b023fe279b154a0"
server_key_version: "encryptionkey@0"
I20260807 15:24:48.059837 18290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:48.079524 18290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:48.082998 18290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:48.083218 18290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:48.090696 18290 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.253:36467
I20260807 15:24:48.091022 18398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.253:36467 every 8 connection(s)
I20260807 15:24:48.091681 18290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
I20260807 15:24:48.094537 18400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:48.095605 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18290
I20260807 15:24:48.095747 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-1/wal/instance
I20260807 15:24:48.096088 16331 external_mini_cluster.cc:1428] Setting key 5601a0ce7c2050e617221d0c3ba09761
I20260807 15:24:48.099608 18400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.242.252@KRBTEST.COM; defaulting to no policy
I20260807 15:24:48.106307 18277 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.252@KRBTEST.COM" created.
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116288, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116287, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:24:48.117874 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.101632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56678 (local address 127.15.242.254:45555)
0807 15:24:48.101831 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.101838 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.102726 (+ 888us) server_negotiation.cc:407] Connection header received
0807 15:24:48.104138 (+ 1412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.104141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.104191 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.104264 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.105994 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.106587 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.108189 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.108573 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.108693 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.112601 (+ 3908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.112606 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.112609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.112654 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.115257 (+ 2603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.115819 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.115825 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.115827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.115915 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.116373 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.116379 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.116383 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.116671 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.116816 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.117516 (+ 700us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.117666 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 15:24:48.118957 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.101968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45555 (local address 127.0.0.1:56678)
0807 15:24:48.102520 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.102584 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:48.103857 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:48.104488 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:48.104498 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:48.105039 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:48.105784 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.105802 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.106721 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.106724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.108056 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.108064 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.108750 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.108754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.109021 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.110464 (+ 1443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:48.110483 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:48.112437 (+ 1954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:48.115382 (+ 2945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.115395 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.115406 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.115702 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.116024 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.116028 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.116030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.116246 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.116833 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:48.116841 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:48.117205 (+ 364us) client_negotiation.cc:769] Sending connection context
0807 15:24:48.117426 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 15:24:48.117789 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":115,"threads_started":1}
I20260807 15:24:48.118954 18404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.107013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34918 (local address 127.15.242.253:36467)
0807 15:24:48.107399 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.107411 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.107436 (+ 25us) server_negotiation.cc:407] Connection header received
0807 15:24:48.107475 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.107481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.107677 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.107840 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.108412 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.109599 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.110372 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.110881 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.110992 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.113669 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.113679 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.113696 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.113728 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.115999 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.116531 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.116538 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.116540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.116637 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.116998 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.117001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.117003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.117301 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.117444 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.118288 (+ 844us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.118463 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":162,"threads_started":1}
I20260807 15:24:48.119537 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.106802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34918)
0807 15:24:48.106971 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.107003 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:48.107317 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:48.107903 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:48.107906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:48.108108 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:48.108239 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.108245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.109704 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.109707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.110249 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.110257 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.111035 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.111043 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.111196 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.111805 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:48.111822 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:48.113472 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:48.116131 (+ 2659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.116134 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.116136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.116411 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.116745 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.116749 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.116751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.116876 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.117498 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:48.117502 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:48.117607 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 15:24:48.117738 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 15:24:48.117891 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 15:24:48.121644 18400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:48.121644 18277 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:48.122727 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.122443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43920)
0807 15:24:48.122572 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.122651 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 15:24:48.123536 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.123218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43924)
0807 15:24:48.123401 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.123462 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260807 15:24:48.124058 18277 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:34437: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116288, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab.
Entry for principal kudu/127.15.242.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab.
I20260807 15:24:48.132308 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.122162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34920)
0807 15:24:48.122315 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.122331 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:48.122407 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:48.122691 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:48.122697 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:48.122888 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:48.123005 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.123011 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.124096 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.124100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.124750 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.124814 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.125335 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.125338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.125475 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.125936 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:48.125949 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:48.127511 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:48.130359 (+ 2848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.130363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.130366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.130621 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.131041 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.131044 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.131046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.131176 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.131770 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:48.131774 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:48.131876 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 15:24:48.131992 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 15:24:48.132159 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 15:24:48.132477 18404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.122259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34920 (local address 127.15.242.253:36467)
0807 15:24:48.122379 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.122384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.122406 (+ 22us) server_negotiation.cc:407] Connection header received
0807 15:24:48.122513 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.122517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.122564 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.122651 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.123137 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.123945 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.124947 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.125218 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.125309 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.127738 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.127741 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.127743 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.127763 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.130156 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.130726 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.130732 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.130736 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.130913 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.131302 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.131305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.131307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.131626 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.131731 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.132151 (+ 420us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.132296 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:24:48.133090 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.252:34437
--webserver_interface=127.15.242.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab
--principal=kudu/127.15.242.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:45555,127.15.242.253:36467,127.15.242.252:34437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:24:48.133237 18400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:48.134094 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.133725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43936)
0807 15:24:48.133911 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.134012 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 15:24:48.134676 18324 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
I20260807 15:24:48.135823 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.135584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43940)
0807 15:24:48.135729 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.135775 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 15:24:48.136018 18400 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:34437: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
I20260807 15:24:48.155264 18277 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } attempt: 1
I20260807 15:24:48.156286 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.155908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43946)
0807 15:24:48.156129 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.156201 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 15:24:48.157318 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.157034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43950)
0807 15:24:48.157201 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.157254 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260807 15:24:48.157472 18277 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:34437: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
I20260807 15:24:48.185288 18400 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } attempt: 1
I20260807 15:24:48.186295 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.185921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43962)
0807 15:24:48.186115 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.186194 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 15:24:48.187129 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.186888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43972)
0807 15:24:48.187008 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.187062 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 15:24:48.187278 18400 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:34437: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
I20260807 15:24:48.232689 18277 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } attempt: 2
I20260807 15:24:48.233639 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.233306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43976)
0807 15:24:48.233476 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.233552 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 15:24:48.234627 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.234404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:43990)
0807 15:24:48.234513 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.234563 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 15:24:48.234869 18277 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:34437: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
W20260807 15:24:48.251710 18409 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 15:24:48.251981 18409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:48.252032 18409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:48.252122 18409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 15:24:48.255437 18400 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } attempt: 2
I20260807 15:24:48.256295 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.255976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:44000)
0807 15:24:48.256137 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.256205 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 15:24:48.256390 18409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:48.256470 18409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:48.256507 18409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:48.256539 18409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:48.256577 18409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:48.257103 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.256872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:44016)
0807 15:24:48.256986 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.257039 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 15:24:48.257282 18400 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:34437: Network error: Client connection negotiation failed: client connection to 127.15.242.252:34437: connect: Connection refused (error 111)
I20260807 15:24:48.262157 18409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:45555,127.15.242.253:36467,127.15.242.252:34437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab
--principal=kudu/127.15.242.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.252:34437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.242.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:48.263213 18409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:48.264230 18409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:48.275710 18419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:48.275755 18423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:48.275725 18420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:48.276075 18409 server_base.cc:1034] running on GCE node
I20260807 15:24:48.276773 18409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:48.278076 18409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:48.279337 18409 hybrid_clock.cc:648] HybridClock initialized: now 1786116288279299 us; error 54 us; skew 500 ppm
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116288, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:48.282307 18409 init.cc:377] Logged in from keytab as kudu/127.15.242.252@KRBTEST.COM (short username kudu)
I20260807 15:24:48.283205 18409 webserver.cc:460] Webserver started at http://127.15.242.252:40069/ using document root <none> and password file <none>
I20260807 15:24:48.283797 18409 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:48.283893 18409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:48.284140 18409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:48.286268 18409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/data/instance:
uuid: "7a20bbef742941039aafe597fc887d68"
format_stamp: "Formatted at 2026-08-07 15:24:48 on dist-test-slave-g170"
server_key: "59784ee5c756a06de77273ffb87a3d4f"
server_key_iv: "1ce63d1040b92e211f4d6d2d7d6a086b"
server_key_version: "encryptionkey@0"
I20260807 15:24:48.286840 18409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/wal/instance:
uuid: "7a20bbef742941039aafe597fc887d68"
format_stamp: "Formatted at 2026-08-07 15:24:48 on dist-test-slave-g170"
server_key: "59784ee5c756a06de77273ffb87a3d4f"
server_key_iv: "1ce63d1040b92e211f4d6d2d7d6a086b"
server_key_version: "encryptionkey@0"
I20260807 15:24:48.290628 18409 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:48.293284 18433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:48.294641 18409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 15:24:48.294796 18409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/wal
uuid: "7a20bbef742941039aafe597fc887d68"
format_stamp: "Formatted at 2026-08-07 15:24:48 on dist-test-slave-g170"
server_key: "59784ee5c756a06de77273ffb87a3d4f"
server_key_iv: "1ce63d1040b92e211f4d6d2d7d6a086b"
server_key_version: "encryptionkey@0"
I20260807 15:24:48.294920 18409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:48.315613 18409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:48.318643 18409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:48.318864 18409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:48.326505 18409 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.252:34437
I20260807 15:24:48.326803 18517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.252:34437 every 8 connection(s)
I20260807 15:24:48.327579 18409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
I20260807 15:24:48.331148 18518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:48.331422 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18409
I20260807 15:24:48.331548 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786115983990396-16331-0/minicluster-data/master-2/wal/instance
I20260807 15:24:48.331874 16331 external_mini_cluster.cc:1428] Setting key 735264cfed7c8a47cd5859d592501765
I20260807 15:24:48.334054 18277 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } attempt: 3
I20260807 15:24:48.336791 18518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116287, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116288, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:48.347054 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.334516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:44020)
0807 15:24:48.334671 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.334693 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:48.334796 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:48.335493 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:48.335496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:48.335704 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:48.335860 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.335868 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.337574 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.337579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.338434 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.338445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.339468 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.339472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.339570 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.340178 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:48.340196 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:48.341692 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:48.345063 (+ 3371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.345067 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.345069 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.345351 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.345692 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.345695 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.345698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.345797 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.346511 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:48.346514 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:48.346618 (+ 104us) client_negotiation.cc:769] Sending connection context
0807 15:24:48.346747 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 15:24:48.346888 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 15:24:48.348188 18524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.333324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.15.242.252:34437)
0807 15:24:48.333815 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.333831 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.333868 (+ 37us) server_negotiation.cc:407] Connection header received
0807 15:24:48.334846 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.334867 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.335194 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.335533 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.336427 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.337403 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.338599 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.339319 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.339483 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.342515 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.342519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.342522 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.342547 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.344936 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.345413 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.345423 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.345432 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.345599 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.346146 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.346149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.346151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.346406 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.346605 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.346947 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.347212 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":314,"spinlock_wait_cycles":2304,"thread_start_us":137,"threads_started":1}
I20260807 15:24:48.348198 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.334568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.15.242.252:34437)
0807 15:24:48.334992 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.335001 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.335014 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:24:48.335053 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.335057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.335196 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.335980 (+ 784us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.336154 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.337404 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.338573 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.339322 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.339821 (+ 499us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.341879 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.341885 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.341897 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.341927 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.344949 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.345450 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.345453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.345454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.345599 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.345885 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.345887 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.345888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.346390 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.346538 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.346901 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.347367 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":420,"server-negotiator.queue_time_us":345,"spinlock_wait_cycles":9472,"thread_start_us":120,"threads_started":1}
I20260807 15:24:48.348428 18400 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } attempt: 3
I20260807 15:24:48.350515 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.339490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56690 (local address 127.15.242.254:45555)
0807 15:24:48.339598 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.339603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.339615 (+ 12us) server_negotiation.cc:407] Connection header received
0807 15:24:48.339651 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.339656 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.339702 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.339780 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.340746 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.341502 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.342677 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.343019 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.343140 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.346138 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.346142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.346144 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.346168 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.348362 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.348977 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.348980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.348982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.349069 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.349421 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.349424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.349425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.349708 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.349784 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.350243 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.350362 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 15:24:48.351255 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.338647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:45555 (local address 127.0.0.1:56690)
0807 15:24:48.339037 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.339087 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:48.339196 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:48.339935 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:48.339940 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:48.340444 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:48.340588 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.340599 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.341618 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.341623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.342539 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.342551 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.343155 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.343160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.343295 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.343855 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:48.343877 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:48.345997 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:48.348493 (+ 2496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.348502 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.348507 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.348874 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.349193 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.349196 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.349198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.349303 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.349866 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:48.349871 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:48.349982 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 15:24:48.350852 (+ 870us) client_negotiation.cc:240] Negotiation successful
0807 15:24:48.351046 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":107,"threads_started":1}
I20260807 15:24:48.353173 18277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f: Bootstrap starting.
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116288, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
I20260807 15:24:48.356186 18277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f: Neither blocks nor log segments found. Creating new log.
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:48.357249 18277 log.cc:824] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:48.357939 18518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:48.358217 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.349182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44022 (local address 127.15.242.252:34437)
0807 15:24:48.349671 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.349677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.349690 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:24:48.349721 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.349723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.349761 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.350341 (+ 580us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.350428 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.351179 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.352283 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.352599 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.352699 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.354778 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.354782 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.354787 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.354813 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.356404 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.356873 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.356877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.356879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.356958 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.357249 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.357253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.357254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.357494 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.357591 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.357900 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.358028 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":112,"threads_started":1}
I20260807 15:24:48.359040 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.348920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:44022)
0807 15:24:48.349239 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.349259 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:48.349348 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:48.349901 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:48.349905 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:48.350092 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:48.350232 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.350240 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.351348 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.351354 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.352146 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.352158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.352846 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.352850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.352923 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.353384 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:48.353396 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:48.354639 (+ 1243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:48.356518 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.356521 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.356523 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.356735 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.357056 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.357059 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.357061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.357152 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.357583 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:48.357586 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:48.357689 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 15:24:48.358664 (+ 975us) client_negotiation.cc:240] Negotiation successful
0807 15:24:48.358835 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221}
I20260807 15:24:48.362025 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.351115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56704 (local address 127.15.242.254:45555)
0807 15:24:48.351210 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.351215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.351686 (+ 471us) server_negotiation.cc:407] Connection header received
0807 15:24:48.351770 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.351774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.351817 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.351891 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.352712 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.353401 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.354493 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.354809 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.354882 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.357861 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.357865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.357867 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.357893 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.360099 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.360632 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.360636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.360638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.360735 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.361081 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.361084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.361086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.361302 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.361433 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.361745 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.361860 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 15:24:48.362391 18400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7: Bootstrap starting.
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116288, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:24:48.365422 18400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:48.366240 18400 log.cc:824] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:48.367240 18277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f: No bootstrap required, opened a new log
I20260807 15:24:48.367626 18404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.358570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34922 (local address 127.15.242.253:36467)
0807 15:24:48.358674 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.358679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.359143 (+ 464us) server_negotiation.cc:407] Connection header received
0807 15:24:48.359284 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.359287 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.359328 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.359391 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.359825 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.360299 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.361322 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.361622 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.361731 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.364018 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.364021 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.364024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.364043 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.365695 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.366197 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.366201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.366210 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.366302 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.366650 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.366653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.366657 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.366891 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.366999 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.367313 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.367438 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 15:24:48.368134 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.358497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:36467 (local address 127.0.0.1:34922)
0807 15:24:48.358759 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.358774 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:48.358857 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:48.359493 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:48.359495 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:48.359622 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:48.359707 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.359712 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.360407 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.360412 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.361185 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.361195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.361847 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.361850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.361960 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.362397 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:48.362416 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:48.363823 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:48.365839 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.365842 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.365844 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.366085 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.366425 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.366428 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.366430 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.366524 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.367009 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:48.367012 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:48.367105 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 15:24:48.367823 (+ 718us) client_negotiation.cc:240] Negotiation successful
0807 15:24:48.367963 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194}
I20260807 15:24:48.368901 18400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7: No bootstrap required, opened a new log
I20260807 15:24:48.369009 18518 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:24:48.371987 18277 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } }
I20260807 15:24:48.372234 18277 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3d65ba4caee41eb87cdafd68bc9016f, State: Initialized, Role: FOLLOWER
I20260807 15:24:48.372579 18277 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } }
I20260807 15:24:48.372918 18400 raft_consensus.cc:348] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } }
I20260807 15:24:48.373136 18400 raft_consensus.cc:729] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954a1335fb164843a9c7cc5b81f9acf7, State: Initialized, Role: FOLLOWER
I20260807 15:24:48.373435 18400 consensus_queue.cc:260] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } }
I20260807 15:24:48.374096 18277 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:48.374665 18400 sys_catalog.cc:564] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [sys.catalog]: configured and running, proceeding with master startup.
Aug 07 15:24:48 dist-test-slave-g170 krb5kdc[18153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116288, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
I20260807 15:24:48.376642 18532 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.376912 18532 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:48.377437 18530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.363544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34932 (local address 127.15.242.253:36467)
0807 15:24:48.363930 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.363965 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.363979 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:24:48.364008 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.364010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.364048 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.364137 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.364894 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.365662 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.366658 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.366917 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.367026 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.370584 (+ 3558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.370587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.370589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.370613 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.372398 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.372900 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.372903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.372905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.373025 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.373339 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.373342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.373344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.373564 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.373750 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.374451 (+ 701us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.374567 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":123,"threads_started":1}
I20260807 15:24:48.380311 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.369481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:34437 (local address 127.0.0.1:44032)
0807 15:24:48.369834 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:48.369846 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:48.369942 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:48.370347 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:48.370351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:48.370511 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:48.370595 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.370603 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.371644 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.371650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.372628 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:48.372638 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.373508 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.373511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:48.373661 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.374223 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:48.374240 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:48.375782 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:48.378654 (+ 2872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.378657 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.378659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.378936 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.379323 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:48.379326 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:48.379327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:48.379408 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:48.379846 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:48.379850 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:48.379935 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 15:24:48.380040 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 15:24:48.380168 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306}
I20260807 15:24:48.380872 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.369663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44032 (local address 127.15.242.252:34437)
0807 15:24:48.369773 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.369778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.369890 (+ 112us) server_negotiation.cc:407] Connection header received
0807 15:24:48.370116 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.370119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.370163 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.370216 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.370708 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.371501 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.372905 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.373229 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.373309 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.375922 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.375925 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.375928 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.375953 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.377832 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.379136 (+ 1304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.379139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.379141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.379228 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.379501 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.379503 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.379505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.379700 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.379810 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.380595 (+ 785us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.380710 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 15:24:48.381980 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:48.383766 18234 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e3d65ba4caee41eb87cdafd68bc9016f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56704
I20260807 15:24:48.383929 18518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68: Bootstrap starting.
I20260807 15:24:48.384011 18234 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:24:48.384130 18234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:48.385780 18234 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } }
I20260807 15:24:48.386879 18518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:48.387171 18361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "954a1335fb164843a9c7cc5b81f9acf7"
I20260807 15:24:48.387442 18361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:48.387853 18518 log.cc:824] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:48.389015 18361 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3d65ba4caee41eb87cdafd68bc9016f in term 1.
I20260807 15:24:48.389497 18201 leader_election.cc:302] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 954a1335fb164843a9c7cc5b81f9acf7, e3d65ba4caee41eb87cdafd68bc9016f; no voters:
I20260807 15:24:48.386574 18290 master_runner.cc:186] Error getting master registration for 127.15.242.252:34437: OK, instance_id { permanent_uuid: "7a20bbef742941039aafe597fc887d68" instance_seqno: 1786116288324345 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 15:24:48.390544 18290 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 15:24:48.388837 18175 master_runner.cc:186] Error getting master registration for 127.15.242.252:34437: OK, instance_id { permanent_uuid: "7a20bbef742941039aafe597fc887d68" instance_seqno: 1786116288324345 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 15:24:48.391968 18175 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 15:24:48.393167 18571 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:48.393255 18571 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:48.393437 18234 leader_election.cc:288] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [CANDIDATE]: Term 1 election: Requested vote from peers 954a1335fb164843a9c7cc5b81f9acf7 (127.15.242.253:36467), 7a20bbef742941039aafe597fc887d68 (127.15.242.252:34437)
I20260807 15:24:48.395510 18532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:48.395803 18532 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [term 1 LEADER]: Becoming Leader. State: Replica: e3d65ba4caee41eb87cdafd68bc9016f, State: Running, Role: LEADER
I20260807 15:24:48.396186 18532 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } }
I20260807 15:24:48.398165 18532 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3d65ba4caee41eb87cdafd68bc9016f. Latest consensus state: current_term: 1 leader_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.398646 18534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.398803 18534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:48.399056 18532 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: This master's current role is: LEADER
W20260807 15:24:48.398988 18559 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:48.399329 18559 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:48.402688 18518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68: No bootstrap required, opened a new log
I20260807 15:24:48.408013 18518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } }
I20260807 15:24:48.408404 18518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a20bbef742941039aafe597fc887d68, State: Initialized, Role: FOLLOWER
I20260807 15:24:48.409018 18585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:48.408957 18518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } }
I20260807 15:24:48.410140 18585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 15:24:48.410956 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.399733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56710 (local address 127.15.242.254:45555)
0807 15:24:48.399867 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.399873 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.401454 (+ 1581us) server_negotiation.cc:407] Connection header received
0807 15:24:48.401644 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.401648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.401721 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.401778 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.402816 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.403611 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.404860 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.405221 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.405296 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.407382 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.407387 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.407390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.407416 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.409124 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.409626 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.409630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.409632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.409716 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.410008 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.410012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.410014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.410238 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.410340 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.410684 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.410802 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 15:24:48.411114 18470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7a20bbef742941039aafe597fc887d68"
I20260807 15:24:48.411368 18470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:48.413379 18470 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3d65ba4caee41eb87cdafd68bc9016f in term 1.
I20260807 15:24:48.411054 18518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:48.414068 18593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.420802 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.400362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44040 (local address 127.15.242.252:34437)
0807 15:24:48.400476 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.400481 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.411874 (+ 11393us) server_negotiation.cc:407] Connection header received
0807 15:24:48.412039 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.412042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.412087 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.412136 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.412993 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.413749 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.414875 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.415224 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.415297 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.417033 (+ 1736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.417037 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.417040 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.417065 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.418797 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.419324 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.419327 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.419329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.419417 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.419733 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.419737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.419738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.419971 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.420128 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.420491 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.420614 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 15:24:48.421769 18593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:48.425624 18470 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [term 1 FOLLOWER]: Refusing update from remote peer e3d65ba4caee41eb87cdafd68bc9016f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:48.426334 18532 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:48.426636 18530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:48.395713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34940 (local address 127.15.242.253:36467)
0807 15:24:48.395855 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.395862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.401170 (+ 5308us) server_negotiation.cc:407] Connection header received
0807 15:24:48.415924 (+ 14754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.415928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.415978 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.416028 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.417016 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.417793 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.418970 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:48.419395 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:48.419474 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:48.421321 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:48.421325 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:48.421328 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:48.421355 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:48.424192 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.425195 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.425199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.425201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.425294 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:48.425608 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:48.425611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:48.425613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:48.425847 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:48.425964 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:48.426364 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 15:24:48.426493 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 15:24:48.427834 18361 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [term 1 FOLLOWER]: Refusing update from remote peer e3d65ba4caee41eb87cdafd68bc9016f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:48.428396 18532 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [LEADER]: Connected to new peer: Peer: permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:48.431610 18593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3d65ba4caee41eb87cdafd68bc9016f. Latest consensus state: current_term: 1 leader_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.431722 18593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:48.432035 18534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3d65ba4caee41eb87cdafd68bc9016f. Latest consensus state: current_term: 1 leader_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.432138 18534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 15:24:48.435551 18606 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:48.435632 18606 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:48.442412 18532 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.442535 18532 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:48.443832 18534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.443940 18534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:48.444376 18594 mvcc.cc:205] Tried to move back new op lower bound from 7315932317384441856 to 7315932317274644480. Current Snapshot: MvccSnapshot[applied={T|T < 7315932317384441856}]
I20260807 15:24:48.444562 18611 mvcc.cc:205] Tried to move back new op lower bound from 7315932317384441856 to 7315932317274644480. Current Snapshot: MvccSnapshot[applied={T|T < 7315932317384441856}]
I20260807 15:24:48.449106 18585 catalog_manager.cc:1347] Generated new cluster ID: 8bed882f50ac4567b0a0cfde3e1c2104
I20260807 15:24:48.449165 18585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:48.456012 18581 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.456126 18581 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:48.457257 18593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3d65ba4caee41eb87cdafd68bc9016f" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 45555 } } peers { permanent_uuid: "954a1335fb164843a9c7cc5b81f9acf7" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 36467 } } peers { permanent_uuid: "7a20bbef742941039aafe597fc887d68" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 34437 } } }
I20260807 15:24:48.457360 18593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:48.526404 18585 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:48.527706 18585 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:48.545760 18585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3d65ba4caee41eb87cdafd68bc9016f: Generated new TSK 0
I20260807 15:24:48.546659 18585 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 15:24:48.592375 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.588966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34944 (local address 127.15.242.253:36467)
0807 15:24:48.589102 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.589108 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.591106 (+ 1998us) server_negotiation.cc:407] Connection header received
0807 15:24:48.591365 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.591369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.591427 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.591487 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.592226 (+ 739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34944: BlockingRecv error: recv got EOF from 127.0.0.1:34944 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260807 15:24:48.594200 18286 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.589730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56714 (local address 127.15.242.254:45555)
0807 15:24:48.589886 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.589892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.593102 (+ 3210us) server_negotiation.cc:407] Connection header received
0807 15:24:48.593263 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.593268 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.593332 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.593426 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.594075 (+ 649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56714: BlockingRecv error: recv got EOF from 127.0.0.1:56714 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260807 15:24:48.594449 18525 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.590425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44046 (local address 127.15.242.252:34437)
0807 15:24:48.590541 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.590546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.593419 (+ 2873us) server_negotiation.cc:407] Connection header received
0807 15:24:48.593605 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.593608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.593658 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.593713 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.594321 (+ 608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44046: BlockingRecv error: recv got EOF from 127.0.0.1:44046 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 15:24:48.599611 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.597153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34950 (local address 127.15.242.253:36467)
0807 15:24:48.597275 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.597281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.597835 (+ 554us) server_negotiation.cc:407] Connection header received
0807 15:24:48.598651 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.598654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.598771 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.598834 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.599505 (+ 671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34950: BlockingRecv error: recv got EOF from 127.0.0.1:34950 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 15:24:48.605643 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.603122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34956 (local address 127.15.242.253:36467)
0807 15:24:48.603259 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.603264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.603816 (+ 552us) server_negotiation.cc:407] Connection header received
0807 15:24:48.604017 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.604021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.604078 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.604132 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.605540 (+ 1408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34956: BlockingRecv error: recv got EOF from 127.0.0.1:34956 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 15:24:48.611563 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.610198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.15.242.253:36467)
0807 15:24:48.610338 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.610345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.610564 (+ 219us) server_negotiation.cc:407] Connection header received
0807 15:24:48.610700 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.610706 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.610772 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.610883 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.611446 (+ 563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34970: BlockingRecv error: recv got EOF from 127.0.0.1:34970 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 15:24:48.619586 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.618206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34984 (local address 127.15.242.253:36467)
0807 15:24:48.618387 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.618392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.618625 (+ 233us) server_negotiation.cc:407] Connection header received
0807 15:24:48.618796 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.618800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.618858 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.618955 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.619456 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34984: BlockingRecv error: recv got EOF from 127.0.0.1:34984 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260807 15:24:48.631502 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.630179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35000 (local address 127.15.242.253:36467)
0807 15:24:48.630335 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.630339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.630464 (+ 125us) server_negotiation.cc:407] Connection header received
0807 15:24:48.630605 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.630607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.630660 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.630745 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.631326 (+ 581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35000: BlockingRecv error: recv got EOF from 127.0.0.1:35000 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 15:24:48.651047 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.649796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35008 (local address 127.15.242.253:36467)
0807 15:24:48.649990 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.649994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.650012 (+ 18us) server_negotiation.cc:407] Connection header received
0807 15:24:48.650224 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.650227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.650293 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.650381 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.650885 (+ 504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35008: BlockingRecv error: recv got EOF from 127.0.0.1:35008 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260807 15:24:48.686542 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.685215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35022 (local address 127.15.242.253:36467)
0807 15:24:48.685370 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.685375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.685572 (+ 197us) server_negotiation.cc:407] Connection header received
0807 15:24:48.685759 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.685762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.685828 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.685922 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.686410 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35022: BlockingRecv error: recv got EOF from 127.0.0.1:35022 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 15:24:48.754591 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.753320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35032 (local address 127.15.242.253:36467)
0807 15:24:48.753552 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.753556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.753674 (+ 118us) server_negotiation.cc:407] Connection header received
0807 15:24:48.753806 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.753809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.753863 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.753953 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.754484 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35032: BlockingRecv error: recv got EOF from 127.0.0.1:35032 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260807 15:24:48.886073 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:48.884847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35042 (local address 127.15.242.253:36467)
0807 15:24:48.885003 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:48.885008 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:48.885292 (+ 284us) server_negotiation.cc:407] Connection header received
0807 15:24:48.885413 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:48.885416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:48.885470 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:48.885545 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:48.885976 (+ 431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35042: BlockingRecv error: recv got EOF from 127.0.0.1:35042 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 15:24:49.145987 18530 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:49.144845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35046 (local address 127.15.242.253:36467)
0807 15:24:49.145020 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:49.145026 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:49.145048 (+ 22us) server_negotiation.cc:407] Connection header received
0807 15:24:49.145130 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:49.145134 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:49.145198 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:49.145305 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:49.145845 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35046: BlockingRecv error: recv got EOF from 127.0.0.1:35046 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 15:24:49.394734 18571 catalog_manager.cc:1259] Loaded cluster ID: 8bed882f50ac4567b0a0cfde3e1c2104
I20260807 15:24:49.394852 18571 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7: loading cluster ID for follower catalog manager: success
I20260807 15:24:49.396584 18571 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7: acquiring CA information for follower catalog manager: success
I20260807 15:24:49.397802 18571 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 954a1335fb164843a9c7cc5b81f9acf7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 15:24:49.437107 18606 catalog_manager.cc:1259] Loaded cluster ID: 8bed882f50ac4567b0a0cfde3e1c2104
I20260807 15:24:49.437191 18606 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68: loading cluster ID for follower catalog manager: success
I20260807 15:24:49.438947 18606 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68: acquiring CA information for follower catalog manager: success
I20260807 15:24:49.440131 18606 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7a20bbef742941039aafe597fc887d68: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 15:24:49.665114 18728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:49.660522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35054 (local address 127.15.242.253:36467)
0807 15:24:49.660874 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:49.660878 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:49.661004 (+ 126us) server_negotiation.cc:407] Connection header received
0807 15:24:49.661145 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:49.661148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:49.661310 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:49.661455 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:49.661752 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.662371 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.663334 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.663586 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.663727 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:49.664158 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:49.664644 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:49.664815 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:49.664908 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 15:24:49.664971 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":73,"threads_started":1}
I20260807 15:24:49.673153 18736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:49.668787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44050 (local address 127.15.242.252:34437)
0807 15:24:49.669067 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:49.669071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:49.669085 (+ 14us) server_negotiation.cc:407] Connection header received
0807 15:24:49.669176 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:49.669178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:49.669529 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:49.669713 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:49.669944 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.670524 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.671414 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.671771 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.671862 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:49.672139 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:49.672582 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:49.672678 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:49.672943 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 15:24:49.673014 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":96,"threads_started":1}
I20260807 15:24:49.680851 18736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:49.676701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44064 (local address 127.15.242.252:34437)
0807 15:24:49.676866 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:49.676870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:49.676944 (+ 74us) server_negotiation.cc:407] Connection header received
0807 15:24:49.677097 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:49.677100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:49.677153 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:49.677223 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:49.677565 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.678519 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.679687 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.679929 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.680055 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:49.680389 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:49.680471 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:49.680548 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:49.680632 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 15:24:49.680687 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:24:49.680851 18728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:49.676335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35068 (local address 127.15.242.253:36467)
0807 15:24:49.676489 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:49.676494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:49.677028 (+ 534us) server_negotiation.cc:407] Connection header received
0807 15:24:49.677162 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:49.677167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:49.677229 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:49.677314 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:49.677682 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.678317 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.679551 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.679891 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.679988 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:49.680298 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:49.680395 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:49.680444 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:49.680631 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 15:24:49.680687 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:24:49.681643 18751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:49.676334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56716 (local address 127.15.242.254:45555)
0807 15:24:49.676987 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:49.676994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:49.677011 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:24:49.677111 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:49.677117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:49.677445 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:49.677569 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:49.678015 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.678827 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.679802 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:49.680132 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:49.680246 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:49.680582 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:49.681159 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:49.681247 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:49.681412 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 15:24:49.681476 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":78,"threads_started":1}
I20260807 15:24:49.685451 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18175
I20260807 15:24:49.698125 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18290
I20260807 15:24:49.715167 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18409
2026-08-07T15:24:49Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3447 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 15:24:49 dist-test-slave-g170 krb5kdc[18756](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 15:24:49 dist-test-slave-g170 krb5kdc[18756](info): set up 2 sockets
Aug 07 15:24:49 dist-test-slave-g170 krb5kdc[18756](info): commencing operation
krb5kdc: starting...
W20260807 15:24:51.062893 16331 mini_kdc.cc:121] Time spent starting KDC: real 1.320s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/test-user.keytab.
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T15:24:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T15:24:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
Entry for principal kudu/127.15.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab.
I20260807 15:24:51.208392 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:37915
--webserver_interface=127.15.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:37915,127.15.242.253:45571,127.15.242.252:39211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 15:24:51.326333 18773 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 15:24:51.326687 18773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:51.326762 18773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:51.326862 18773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:51.331053 18773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:51.331147 18773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:51.331185 18773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:51.331223 18773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:51.331260 18773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:51.336571 18773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:37915,127.15.242.253:45571,127.15.242.252:39211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.254.keytab
--principal=kudu/127.15.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.254:37915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:51.337744 18773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:51.338865 18773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:51.348034 18781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:51.348034 18779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:51.348210 18773 server_base.cc:1034] running on GCE node
W20260807 15:24:51.348045 18784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:51.349087 18773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:51.350275 18773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:51.351456 18773 hybrid_clock.cc:648] HybridClock initialized: now 1786116291351412 us; error 57 us; skew 500 ppm
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:51.359318 18773 init.cc:377] Logged in from keytab as kudu/127.15.242.254@KRBTEST.COM (short username kudu)
I20260807 15:24:51.360332 18773 webserver.cc:460] Webserver started at http://127.15.242.254:35185/ using document root <none> and password file <none>
I20260807 15:24:51.361029 18773 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:51.361102 18773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:51.361294 18773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:51.363517 18773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/data/instance:
uuid: "3b0efec8b2ca4bd2997c84b342d162dc"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "590c68c0e9d5ef0f79c2768caeebd9b5"
server_key_iv: "a02e6f2d7fb2fac9dc1d0273b0036044"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.364095 18773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/wal/instance:
uuid: "3b0efec8b2ca4bd2997c84b342d162dc"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "590c68c0e9d5ef0f79c2768caeebd9b5"
server_key_iv: "a02e6f2d7fb2fac9dc1d0273b0036044"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.368271 18773 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 15:24:51.370952 18792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:51.372414 18773 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 15:24:51.372596 18773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/wal
uuid: "3b0efec8b2ca4bd2997c84b342d162dc"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "590c68c0e9d5ef0f79c2768caeebd9b5"
server_key_iv: "a02e6f2d7fb2fac9dc1d0273b0036044"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.372735 18773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:51.401612 18773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:51.405053 18773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:51.405292 18773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:51.413357 18773 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.254:37915
I20260807 15:24:51.413684 18870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.254:37915 every 8 connection(s)
I20260807 15:24:51.414433 18773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/data/info.pb
I20260807 15:24:51.416699 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18773
I20260807 15:24:51.416877 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-0/wal/instance
I20260807 15:24:51.417227 16331 external_mini_cluster.cc:1428] Setting key 732642eac3ffc52553e85ca684c1f39f
I20260807 15:24:51.417703 18871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:51.421950 18871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.242.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.253@KRBTEST.COM" created.
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:51.439421 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.425690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33450 (local address 127.15.242.254:37915)
0807 15:24:51.426044 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.426058 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.426114 (+ 56us) server_negotiation.cc:407] Connection header received
0807 15:24:51.426613 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.426621 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.426916 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.427169 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.428080 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.429184 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.430391 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.430833 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.430976 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.433687 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.433698 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.433714 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.433794 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.435987 (+ 2193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.436538 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.436548 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.436553 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.436714 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.437146 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.437153 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.437157 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.437695 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.437859 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.438372 (+ 513us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.438671 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":220,"thread_start_us":95,"threads_started":1}
I20260807 15:24:51.439421 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.424730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:37915 (local address 127.0.0.1:33450)
0807 15:24:51.425268 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.425322 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.426262 (+ 940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.427175 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.427181 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.427526 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.427846 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.427862 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.429345 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.429348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.430253 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.430264 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.431017 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.431024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.431189 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.431895 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.431922 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.433538 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.436122 (+ 2584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.436132 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.436140 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.436403 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.436890 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.436894 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.436895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.437036 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.437898 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.437904 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.438050 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.438215 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.438522 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":130,"threads_started":1}
I20260807 15:24:51.442106 18871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:51.442945 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.442626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35870)
0807 15:24:51.442745 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.442851 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 15:24:51.443176 18793 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
I20260807 15:24:51.443974 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.443778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35872)
0807 15:24:51.443883 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.443927 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 15:24:51.444239 18871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:45571: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab.
Entry for principal kudu/127.15.242.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab.
I20260807 15:24:51.448369 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.253:45571
--webserver_interface=127.15.242.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab
--principal=kudu/127.15.242.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:37915,127.15.242.253:45571,127.15.242.252:39211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:24:51.493517 18871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } attempt: 1
I20260807 15:24:51.494519 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.494170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35886)
0807 15:24:51.494363 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.494433 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260807 15:24:51.495354 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.495112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35894)
0807 15:24:51.495246 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.495298 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 15:24:51.495499 18871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:45571: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
I20260807 15:24:51.563676 18871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } attempt: 2
I20260807 15:24:51.564662 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.564279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35908)
0807 15:24:51.564447 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.564547 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 15:24:51.565372 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.565158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35910)
0807 15:24:51.565263 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.565320 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 15:24:51.565502 18871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.253:45571: Network error: Client connection negotiation failed: client connection to 127.15.242.253:45571: connect: Connection refused (error 111)
W20260807 15:24:51.571168 18881 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 15:24:51.571485 18881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:51.571547 18881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:51.571621 18881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 15:24:51.576292 18881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:51.576368 18881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:51.576413 18881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:51.576447 18881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:51.576486 18881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:51.582094 18881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:37915,127.15.242.253:45571,127.15.242.252:39211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.253.keytab
--principal=kudu/127.15.242.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.253:45571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.242.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:51.583158 18881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:51.584157 18881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:51.592659 18893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:51.592717 18887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:51.592893 18889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:51.593080 18881 server_base.cc:1034] running on GCE node
I20260807 15:24:51.593698 18881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:51.594863 18881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:51.596066 18881 hybrid_clock.cc:648] HybridClock initialized: now 1786116291596033 us; error 46 us; skew 500 ppm
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:51.599043 18881 init.cc:377] Logged in from keytab as kudu/127.15.242.253@KRBTEST.COM (short username kudu)
I20260807 15:24:51.600004 18881 webserver.cc:460] Webserver started at http://127.15.242.253:38179/ using document root <none> and password file <none>
I20260807 15:24:51.600602 18881 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:51.600715 18881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:51.600991 18881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:51.603173 18881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/data/instance:
uuid: "9a9556984f6546638bcbb44c9fb3b878"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "be1b2649fee572bc84c6decd3e3ee394"
server_key_iv: "74f63a6326c3dbad506fbc969e91a1c4"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.603785 18881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/wal/instance:
uuid: "9a9556984f6546638bcbb44c9fb3b878"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "be1b2649fee572bc84c6decd3e3ee394"
server_key_iv: "74f63a6326c3dbad506fbc969e91a1c4"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.607671 18881 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 15:24:51.610306 18902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:51.611577 18881 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 15:24:51.611752 18881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/wal
uuid: "9a9556984f6546638bcbb44c9fb3b878"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "be1b2649fee572bc84c6decd3e3ee394"
server_key_iv: "74f63a6326c3dbad506fbc969e91a1c4"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.611873 18881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:51.637842 18881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:51.641672 18881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:51.641916 18881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:51.650732 18881 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.253:45571
I20260807 15:24:51.651036 18980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.253:45571 every 8 connection(s)
I20260807 15:24:51.651921 18881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/data/info.pb
I20260807 15:24:51.654945 18981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:51.656204 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18881
I20260807 15:24:51.656355 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-1/wal/instance
I20260807 15:24:51.656736 16331 external_mini_cluster.cc:1428] Setting key 94310c63d4cf5896aeecf4e71414c9be
I20260807 15:24:51.656713 18871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } attempt: 3
I20260807 15:24:51.660017 18981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.242.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.242.252@KRBTEST.COM" created.
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:51.672760 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.657334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35926)
0807 15:24:51.657549 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.657566 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.657666 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.660582 (+ 2916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.660586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.660831 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.660984 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.660992 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.663052 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.663059 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.664034 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.664051 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.665232 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.665239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.665474 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.666234 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.666253 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.667912 (+ 1659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.670400 (+ 2488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.670406 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.670408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.670639 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.671052 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.671055 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.671057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.671164 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.671985 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.671992 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.672147 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.672396 (+ 249us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.672567 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":56}
I20260807 15:24:51.674249 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.658064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35926 (local address 127.15.242.253:45571)
0807 15:24:51.658548 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.658564 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.658602 (+ 38us) server_negotiation.cc:407] Connection header received
0807 15:24:51.659681 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.659713 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.660221 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.660611 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.661242 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.662827 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.664212 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.665046 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.665341 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.668062 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.668069 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.668089 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.668112 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.670264 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.670765 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.670774 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.670785 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.670922 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.671265 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.671269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.671271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.671844 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.672002 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.672573 (+ 571us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.672980 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":172,"threads_started":1}
I20260807 15:24:51.676656 18871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:51.677095 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.662174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33458 (local address 127.15.242.254:37915)
0807 15:24:51.662318 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.662322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.662685 (+ 363us) server_negotiation.cc:407] Connection header received
0807 15:24:51.662935 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.662941 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.663002 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.663082 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.663753 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.665556 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.666750 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.667102 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.667235 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.672946 (+ 5711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.672952 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.672958 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.672992 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.674900 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.675414 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.675418 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.675419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.675512 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.675865 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.675872 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.675877 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.676110 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.676237 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.676714 (+ 477us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.676909 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":46}
I20260807 15:24:51.677582 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.662096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:37915 (local address 127.0.0.1:33458)
0807 15:24:51.662548 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.662604 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.662798 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.663132 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.663137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.663498 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.663620 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.663626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.665693 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.665701 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.666599 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.666609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.667291 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.667297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.667419 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.668007 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.668033 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.672748 (+ 4715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.675026 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.675036 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.675042 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.675294 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.675645 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.675648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.675650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.675744 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.676238 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.676245 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.676421 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.677229 (+ 808us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.677442 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":147,"threads_started":1}
I20260807 15:24:51.677667 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.677273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39616)
0807 15:24:51.677475 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.677557 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260807 15:24:51.678412 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.678155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39622)
0807 15:24:51.678298 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.678364 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260807 15:24:51.678632 18871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:39211: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
I20260807 15:24:51.679019 18981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:24:51.688622 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.679447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35942)
0807 15:24:51.679557 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.679572 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.679677 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.679905 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.679908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.680081 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.680149 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.680154 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.680897 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.680900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.681442 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.681450 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.681911 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.681915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.681995 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.682496 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.682516 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.685300 (+ 2784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.687079 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.687088 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.687089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.687297 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.687656 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.687658 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.687660 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.687738 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.688235 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.688237 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.688316 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.688401 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.688504 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 15:24:51.688748 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.679598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35942 (local address 127.15.242.253:45571)
0807 15:24:51.679723 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.679729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.679742 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:24:51.679772 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.679775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.679810 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.679895 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.680259 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.680797 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.681559 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.681806 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.681913 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.685440 (+ 3527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.685443 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.685445 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.685467 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.686897 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.687409 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.687412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.687413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.687536 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.687824 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.687826 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.687828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.688074 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.688229 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.688468 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.688567 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 15:24:51.690182 18981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:51.690989 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.690652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39630)
0807 15:24:51.690810 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.690888 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260807 15:24:51.691262 18908 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.242.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab.
Entry for principal kudu/127.15.242.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab.
I20260807 15:24:51.692269 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.692051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39634)
0807 15:24:51.692160 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.692217 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 15:24:51.692494 18981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:39211: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
I20260807 15:24:51.692974 16331 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
/tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.252:39211
--webserver_interface=127.15.242.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab
--principal=kudu/127.15.242.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.242.212:37609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.242.254:37915,127.15.242.253:45571,127.15.242.252:39211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 15:24:51.709812 18871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } attempt: 1
I20260807 15:24:51.710718 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.710369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39650)
0807 15:24:51.710531 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.710598 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 15:24:51.711508 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.711274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39652)
0807 15:24:51.711397 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.711450 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 15:24:51.711647 18871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:39211: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
I20260807 15:24:51.741855 18981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } attempt: 1
I20260807 15:24:51.742862 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.742463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39668)
0807 15:24:51.742654 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.742772 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 15:24:51.743808 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.743537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39670)
0807 15:24:51.743694 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.743744 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 15:24:51.744025 18981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:39211: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
I20260807 15:24:51.786880 18871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } attempt: 2
I20260807 15:24:51.787884 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.787514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39686)
0807 15:24:51.787697 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.787794 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 15:24:51.788949 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.788536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39690)
0807 15:24:51.788795 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.788869 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260807 15:24:51.789156 18871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:39211: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
W20260807 15:24:51.809847 18997 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 15:24:51.810118 18997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 15:24:51.810142 18997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 15:24:51.810181 18997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 15:24:51.812201 18981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } attempt: 2
I20260807 15:24:51.813084 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.812790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39694)
0807 15:24:51.812944 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.813007 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 15:24:51.813910 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.813639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39710)
0807 15:24:51.813780 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.813845 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260807 15:24:51.814126 18981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.242.252:39211: Network error: Client connection negotiation failed: client connection to 127.15.242.252:39211: connect: Connection refused (error 111)
W20260807 15:24:51.814625 18997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 15:24:51.814674 18997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 15:24:51.814693 18997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 15:24:51.814733 18997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 15:24:51.814769 18997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 15:24:51.820235 18997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.242.212:37609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.242.254:37915,127.15.242.253:45571,127.15.242.252:39211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/krb5kdc/kudu_127.15.242.252.keytab
--principal=kudu/127.15.242.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.242.252:39211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.242.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 13:48:26 UTC on ccycloud.quasar-cbxhxa.root.comops.site
build id 4572145
I20260807 15:24:51.821412 18997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 15:24:51.822472 18997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 15:24:51.831271 19009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:51.831336 19005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 15:24:51.831346 19004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 15:24:51.831856 18997 server_base.cc:1034] running on GCE node
I20260807 15:24:51.832417 18997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 15:24:51.833606 18997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 15:24:51.834816 18997 hybrid_clock.cc:648] HybridClock initialized: now 1786116291834802 us; error 30 us; skew 500 ppm
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 15:24:51.837711 18997 init.cc:377] Logged in from keytab as kudu/127.15.242.252@KRBTEST.COM (short username kudu)
I20260807 15:24:51.838655 18997 webserver.cc:460] Webserver started at http://127.15.242.252:40515/ using document root <none> and password file <none>
I20260807 15:24:51.839264 18997 fs_manager.cc:359] Metadata directory not provided
I20260807 15:24:51.839329 18997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 15:24:51.839557 18997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 15:24:51.841822 18997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/data/instance:
uuid: "4086da31c63f4457af498264f78efff8"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "b88e5c2a6828fe2f53fe8170904fb74c"
server_key_iv: "e7a786d11164dbedc5462be898269933"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.842541 18997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/wal/instance:
uuid: "4086da31c63f4457af498264f78efff8"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "b88e5c2a6828fe2f53fe8170904fb74c"
server_key_iv: "e7a786d11164dbedc5462be898269933"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.846863 18997 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 15:24:51.849670 19022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 15:24:51.851354 18997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 15:24:51.851524 18997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/data,/tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/wal
uuid: "4086da31c63f4457af498264f78efff8"
format_stamp: "Formatted at 2026-08-07 15:24:51 on dist-test-slave-g170"
server_key: "b88e5c2a6828fe2f53fe8170904fb74c"
server_key_iv: "e7a786d11164dbedc5462be898269933"
server_key_version: "encryptionkey@0"
I20260807 15:24:51.851671 18997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 15:24:51.863709 18997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 15:24:51.867224 18997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 15:24:51.867437 18997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 15:24:51.875151 18997 rpc_server.cc:307] RPC server started. Bound to: 127.15.242.252:39211
I20260807 15:24:51.875454 19089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.242.252:39211 every 8 connection(s)
I20260807 15:24:51.876184 18997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/data/info.pb
I20260807 15:24:51.879550 19090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 15:24:51.880649 16331 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu as pid 18997
I20260807 15:24:51.880846 16331 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskB0Q6oi/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786115983990396-16331-0/minicluster-data/master-2/wal/instance
I20260807 15:24:51.881143 16331 external_mini_cluster.cc:1428] Setting key 92a476004202d40579d4ab5aba659d66
I20260807 15:24:51.884265 19090 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:51.888345 18871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } attempt: 3
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.254@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
I20260807 15:24:51.897617 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.886236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33468 (local address 127.15.242.254:37915)
0807 15:24:51.886381 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.886387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.886693 (+ 306us) server_negotiation.cc:407] Connection header received
0807 15:24:51.886887 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.886890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.886940 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.887036 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.887817 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.888435 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.889909 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.890296 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.890408 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.893323 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.893328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.893331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.893361 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.895246 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.895759 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.895763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.895765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.895863 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.896306 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.896311 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.896316 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.896695 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.896811 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.897275 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.897459 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 15:24:51.897876 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.882553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39724 (local address 127.15.242.252:39211)
0807 15:24:51.883056 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.883085 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.883120 (+ 35us) server_negotiation.cc:407] Connection header received
0807 15:24:51.883770 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.883787 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.884117 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.884466 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.885465 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.886875 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.887744 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.888229 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.888399 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.891472 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.891479 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.891492 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.891519 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.893719 (+ 2200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.894516 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.894525 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.894534 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.894707 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.895070 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.895074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.895076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.895578 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.895764 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.896337 (+ 573us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.896704 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"spinlock_wait_cycles":1920,"thread_start_us":157,"threads_started":1}
I20260807 15:24:51.897873 19096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.886163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.254:37915 (local address 127.0.0.1:33468)
0807 15:24:51.886562 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.886605 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.886758 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.887102 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.887108 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.887540 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.887679 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.887685 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.888645 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.888652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.889715 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.889730 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.890464 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.890470 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.890615 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.891217 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.891242 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.893141 (+ 1899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.895343 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.895352 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.895356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.895598 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.896000 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.896004 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.896006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.896161 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.896884 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.896892 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.897038 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.897211 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.897428 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":142,"threads_started":1}
I20260807 15:24:51.899600 19090 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } has no permanent_uuid. Determining permanent_uuid...
I20260807 15:24:51.900091 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.888819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39738)
0807 15:24:51.889044 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.889061 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.889161 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.889428 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.889431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.889625 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.889702 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.889708 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.890898 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.890903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.891609 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.891620 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.892303 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.892307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.892395 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.893000 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.893020 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.894478 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.897926 (+ 3448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.897930 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.897932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.898195 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.898536 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.898540 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.898542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.898629 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.899525 (+ 896us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.899528 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.899638 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.899774 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.899928 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260807 15:24:51.900113 19100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.888879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39738 (local address 127.15.242.252:39211)
0807 15:24:51.889186 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.889199 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.889216 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:24:51.889255 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.889258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.889305 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.889409 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.889825 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.890677 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.891749 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.892159 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.892279 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.894631 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.894634 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.894638 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.894671 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.897788 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.898337 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.898340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.898341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.898426 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.898742 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.898745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.898746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.898937 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.899039 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.899850 (+ 811us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.899967 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":86,"threads_started":1}
I20260807 15:24:51.903553 18871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc: Bootstrap starting.
I20260807 15:24:51.905323 18981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } attempt: 3
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:24:51.906692 18871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc: Neither blocks nor log segments found. Creating new log.
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.254@KRBTEST.COM
I20260807 15:24:51.907693 18871 log.cc:824] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:51.909722 19096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.900364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.253:45571 (local address 127.0.0.1:35958)
0807 15:24:51.901033 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.901049 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.901195 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.901480 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.901483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.901665 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.901773 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.901779 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.902560 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.902566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.903198 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.903207 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.903775 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.903779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.903889 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.904398 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.904412 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.905838 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.907885 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.907888 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.907890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.908140 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.908604 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.908608 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.908610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.908736 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.909195 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.909199 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.909304 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.909415 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.909550 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594}
I20260807 15:24:51.910121 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.900693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35958 (local address 127.15.242.253:45571)
0807 15:24:51.900863 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.900868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.901117 (+ 249us) server_negotiation.cc:407] Connection header received
0807 15:24:51.901294 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.901297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.901348 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.901467 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.901902 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.902443 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.903370 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.903660 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.903776 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.905992 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.905996 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.905999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.906018 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.907770 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.908418 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.908421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.908422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.908499 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.908850 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.908854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.908855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.909075 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.909171 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.909525 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.909633 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 15:24:51.911245 19090 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.253@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
I20260807 15:24:51.913084 18871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc: No bootstrap required, opened a new log
I20260807 15:24:51.913098 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.901006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33472 (local address 127.15.242.254:37915)
0807 15:24:51.901105 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.901109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.901122 (+ 13us) server_negotiation.cc:407] Connection header received
0807 15:24:51.901219 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.901222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.901269 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.901352 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.902164 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.902847 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.903888 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.904198 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.904272 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.907855 (+ 3583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.907862 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.907868 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.907899 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.909698 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.910136 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.910140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.910142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.910235 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.910576 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.910579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.910581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.910830 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.911010 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.912818 (+ 1808us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.912941 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 15:24:51.915969 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.906575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39746 (local address 127.15.242.252:39211)
0807 15:24:51.906699 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.906705 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.906733 (+ 28us) server_negotiation.cc:407] Connection header received
0807 15:24:51.906826 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.906832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.907118 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.907496 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.908170 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.908987 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.909996 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.910354 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.910776 (+ 422us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.912502 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.912505 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.912510 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.912536 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.914163 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.914639 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.914641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.914643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.914732 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.915047 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.915053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.915058 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.915303 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.915400 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.915733 (+ 333us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.915836 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 15:24:51.915970 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.905750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39746)
0807 15:24:51.905937 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.905953 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.906017 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.907336 (+ 1319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.907339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.907921 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.908023 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.908033 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.909115 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.909119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.909848 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.909862 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.910487 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.910492 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.910579 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.910996 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.911016 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.912367 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.914284 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.914288 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.914290 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.914523 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.914837 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.914841 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.914842 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.914941 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.915452 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.915455 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.915551 (+ 96us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.915677 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.915820 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.242.252@KRBTEST.COM for kudu/127.15.242.252@KRBTEST.COM
I20260807 15:24:51.918393 18871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } }
I20260807 15:24:51.918898 18871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b0efec8b2ca4bd2997c84b342d162dc, State: Initialized, Role: FOLLOWER
I20260807 15:24:51.919775 18871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } }
I20260807 15:24:51.920459 18981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878: Bootstrap starting.
Aug 07 15:24:51 dist-test-slave-g170 krb5kdc[18756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786116291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.242.253@KRBTEST.COM
I20260807 15:24:51.921449 18871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:51.922367 19096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.911739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.242.252:39211 (local address 127.0.0.1:39760)
0807 15:24:51.911894 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 15:24:51.911906 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 15:24:51.911990 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 15:24:51.912185 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 15:24:51.912187 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 15:24:51.912348 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 15:24:51.912406 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.912410 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.913718 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.913723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.914530 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 15:24:51.914540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.915222 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.915226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 15:24:51.915300 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.916464 (+ 1164us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 15:24:51.916479 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 15:24:51.918192 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 15:24:51.920500 (+ 2308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.920503 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.920505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.920850 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.921227 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 15:24:51.921230 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 15:24:51.921232 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 15:24:51.921325 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 15:24:51.921825 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 15:24:51.921831 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 15:24:51.921929 (+ 98us) client_negotiation.cc:769] Sending connection context
0807 15:24:51.922047 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 15:24:51.922207 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260807 15:24:51.922974 19100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.911768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39760 (local address 127.15.242.252:39211)
0807 15:24:51.911856 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.911861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.911969 (+ 108us) server_negotiation.cc:407] Connection header received
0807 15:24:51.912058 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.912064 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.912107 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.912173 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.912538 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.913594 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.914638 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.915015 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.915112 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.918352 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.918356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.918359 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.918381 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.920374 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.920965 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.920968 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.920970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.921120 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.921418 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.921420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.921422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.921687 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.921788 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.922708 (+ 920us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.922828 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31,"spinlock_wait_cycles":1920}
I20260807 15:24:51.925776 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.914817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35974 (local address 127.15.242.253:45571)
0807 15:24:51.914923 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.914927 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.915114 (+ 187us) server_negotiation.cc:407] Connection header received
0807 15:24:51.915287 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.915291 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.915334 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.915380 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.916293 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.917128 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.918260 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.918570 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.918662 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.921619 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.921622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.921625 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.921650 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.923328 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.923873 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.923879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.923884 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.923985 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.924324 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.924328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.924329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.924559 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.924751 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.925517 (+ 766us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.925629 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 15:24:51.922500 19102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.925985 19102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:51.926563 19090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8: Bootstrap starting.
W20260807 15:24:51.928042 19120 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:51.928140 19120 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:51.929116 18981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:51.929453 19090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8: Neither blocks nor log segments found. Creating new log.
I20260807 15:24:51.930085 18981 log.cc:824] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:51.930728 19090 log.cc:824] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8: Log is configured to *not* fsync() on all Append() calls
I20260807 15:24:51.927287 18773 master_runner.cc:186] Error getting master registration for 127.15.242.253:45571: OK, instance_id { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" instance_seqno: 1786116291648264 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 15:24:51.930940 18773 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 15:24:51.932019 16331 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 15:24:51.933225 18834 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3b0efec8b2ca4bd2997c84b342d162dc"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33472
I20260807 15:24:51.933398 19090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8: No bootstrap required, opened a new log
I20260807 15:24:51.933444 18834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 15:24:51.933591 18834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:51.934636 18834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } }
I20260807 15:24:51.935551 18834 leader_election.cc:288] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [CANDIDATE]: Term 1 election: Requested vote from peers 9a9556984f6546638bcbb44c9fb3b878 (127.15.242.253:45571), 4086da31c63f4457af498264f78efff8 (127.15.242.252:39211)
I20260807 15:24:51.937899 19090 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } }
I20260807 15:24:51.938156 19090 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4086da31c63f4457af498264f78efff8, State: Initialized, Role: FOLLOWER
I20260807 15:24:51.938539 19090 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } }
I20260807 15:24:51.939949 19090 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:51.939975 19136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.940131 19136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:51.940290 19056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4086da31c63f4457af498264f78efff8"
I20260807 15:24:51.940502 19056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:51.942075 19056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b0efec8b2ca4bd2997c84b342d162dc in term 1.
I20260807 15:24:51.942404 18981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878: No bootstrap required, opened a new log
I20260807 15:24:51.942709 18796 leader_election.cc:302] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b0efec8b2ca4bd2997c84b342d162dc, 4086da31c63f4457af498264f78efff8; no voters:
I20260807 15:24:51.943035 19102 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 15:24:51.943272 19102 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [term 1 LEADER]: Becoming Leader. State: Replica: 3b0efec8b2ca4bd2997c84b342d162dc, State: Running, Role: LEADER
I20260807 15:24:51.943634 19102 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } }
I20260807 15:24:51.945713 19102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b0efec8b2ca4bd2997c84b342d162dc. Latest consensus state: current_term: 1 leader_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.945839 19102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:51.946609 18981 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } }
I20260807 15:24:51.946833 18981 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9556984f6546638bcbb44c9fb3b878, State: Initialized, Role: FOLLOWER
I20260807 15:24:51.947147 18981 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } }
I20260807 15:24:51.948508 18981 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 15:24:51.948956 18943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9a9556984f6546638bcbb44c9fb3b878"
I20260807 15:24:51.949213 18943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [term 0 FOLLOWER]: Advancing to term 1
I20260807 15:24:51.950488 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.938682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33476 (local address 127.15.242.254:37915)
0807 15:24:51.938807 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.938811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.940457 (+ 1646us) server_negotiation.cc:407] Connection header received
0807 15:24:51.940654 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.940658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.940708 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.940791 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.941810 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.942584 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.943969 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.944298 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.944376 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.946629 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.946635 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.946642 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.946677 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.948502 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.949037 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.949041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.949043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.949134 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.949492 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.949495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.949497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.949719 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.949837 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.950193 (+ 356us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.950316 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 15:24:51.950744 18943 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b0efec8b2ca4bd2997c84b342d162dc in term 1.
I20260807 15:24:51.955893 19142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 15:24:51.959605 19142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260807 15:24:51.962935 19174 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:51.963029 19174 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:51.964634 19100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.939361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39762 (local address 127.15.242.252:39211)
0807 15:24:51.939473 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.939478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.952133 (+ 12655us) server_negotiation.cc:407] Connection header received
0807 15:24:51.952346 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.952349 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.952400 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.952452 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.956392 (+ 3940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.957135 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.958165 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.958514 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.958586 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.960289 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.960292 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.960295 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.960325 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.962578 (+ 2253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.963113 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.963117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.963119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.963228 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.963555 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.963562 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.963567 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.963819 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.963949 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.964334 (+ 385us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.964470 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 15:24:51.964846 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:51.937870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35978 (local address 127.15.242.253:45571)
0807 15:24:51.937999 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:51.938004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:51.938917 (+ 913us) server_negotiation.cc:407] Connection header received
0807 15:24:51.939325 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:51.939343 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:51.939399 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:51.939460 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:51.948007 (+ 8547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.948808 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.953548 (+ 4740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:51.953871 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:51.953950 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:51.960688 (+ 6738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 15:24:51.960694 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 15:24:51.960702 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 15:24:51.960739 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 15:24:51.962535 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.963432 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.963436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.963438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.963530 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 15:24:51.963858 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 15:24:51.963865 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 15:24:51.963867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 15:24:51.964091 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 15:24:51.964205 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:51.964549 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 15:24:51.964667 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 15:24:51.966122 19175 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 15:24:51.966209 19175 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 15:24:51.966661 19143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.966789 19143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:51.971442 18943 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [term 1 FOLLOWER]: Refusing update from remote peer 3b0efec8b2ca4bd2997c84b342d162dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:51.972064 19056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [term 1 FOLLOWER]: Refusing update from remote peer 3b0efec8b2ca4bd2997c84b342d162dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 15:24:51.972318 19102 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:51.976178 19102 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 15:24:51.981156 19136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b0efec8b2ca4bd2997c84b342d162dc. Latest consensus state: current_term: 1 leader_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.981318 19136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:51.982699 19143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b0efec8b2ca4bd2997c84b342d162dc. Latest consensus state: current_term: 1 leader_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.982846 19143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:51.985914 19140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.986312 19179 mvcc.cc:205] Tried to move back new op lower bound from 7315932331908083712 to 7315932331804966912. Current Snapshot: MvccSnapshot[applied={T|T < 7315932331908083712}]
I20260807 15:24:51.987279 19136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.987398 19136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:51.987430 19102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.987536 19102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:51.988969 19180 mvcc.cc:205] Tried to move back new op lower bound from 7315932331908083712 to 7315932331804966912. Current Snapshot: MvccSnapshot[applied={T|T < 7315932331908083712}]
I20260807 15:24:51.989310 19143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b0efec8b2ca4bd2997c84b342d162dc" member_type: VOTER last_known_addr { host: "127.15.242.254" port: 37915 } } peers { permanent_uuid: "9a9556984f6546638bcbb44c9fb3b878" member_type: VOTER last_known_addr { host: "127.15.242.253" port: 45571 } } peers { permanent_uuid: "4086da31c63f4457af498264f78efff8" member_type: VOTER last_known_addr { host: "127.15.242.252" port: 39211 } } }
I20260807 15:24:51.989394 19143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 15:24:51.989948 19140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc [sys.catalog]: This master's current role is: LEADER
I20260807 15:24:51.991817 19181 mvcc.cc:205] Tried to move back new op lower bound from 7315932331908083712 to 7315932331804966912. Current Snapshot: MvccSnapshot[applied={T|T < 7315932331908083712}]
I20260807 15:24:51.998569 19142 catalog_manager.cc:1347] Generated new cluster ID: dfc11f3929f5493a98affaaf27b70c50
I20260807 15:24:51.998659 19142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 15:24:52.029462 19142 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 15:24:52.033408 19142 catalog_manager.cc:1504] Loading token signing keys...
I20260807 15:24:52.049801 19142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b0efec8b2ca4bd2997c84b342d162dc: Generated new TSK 0
I20260807 15:24:52.050786 19142 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 15:24:52.084859 18876 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.081300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33480 (local address 127.15.242.254:37915)
0807 15:24:52.081436 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.081441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.082792 (+ 1351us) server_negotiation.cc:407] Connection header received
0807 15:24:52.083787 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.083791 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.083853 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.083911 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.084688 (+ 777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33480: BlockingRecv error: recv got EOF from 127.0.0.1:33480 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 15:24:52.086572 19100 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.082120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39778 (local address 127.15.242.252:39211)
0807 15:24:52.082259 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.082263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.085313 (+ 3050us) server_negotiation.cc:407] Connection header received
0807 15:24:52.085666 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.085670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.085730 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.085786 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.086407 (+ 621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39778: BlockingRecv error: recv got EOF from 127.0.0.1:39778 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 15:24:52.087910 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.083102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35982 (local address 127.15.242.253:45571)
0807 15:24:52.083233 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.083237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.086961 (+ 3724us) server_negotiation.cc:407] Connection header received
0807 15:24:52.087151 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.087155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.087218 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.087271 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.087786 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35982: BlockingRecv error: recv got EOF from 127.0.0.1:35982 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 15:24:52.095269 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.093290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35992 (local address 127.15.242.253:45571)
0807 15:24:52.093425 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.093430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.094056 (+ 626us) server_negotiation.cc:407] Connection header received
0807 15:24:52.094339 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.094342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.094432 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.094488 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.095112 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35992: BlockingRecv error: recv got EOF from 127.0.0.1:35992 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 15:24:52.100868 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.099156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35996 (local address 127.15.242.253:45571)
0807 15:24:52.099284 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.099288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.099784 (+ 496us) server_negotiation.cc:407] Connection header received
0807 15:24:52.099995 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.099998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.100055 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.100107 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.100645 (+ 538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35996: BlockingRecv error: recv got EOF from 127.0.0.1:35996 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 15:24:52.106798 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.105257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36006 (local address 127.15.242.253:45571)
0807 15:24:52.105367 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.105371 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.105860 (+ 489us) server_negotiation.cc:407] Connection header received
0807 15:24:52.106055 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.106058 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.106112 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.106164 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.106691 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36006: BlockingRecv error: recv got EOF from 127.0.0.1:36006 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 15:24:52.114737 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.113168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36008 (local address 127.15.242.253:45571)
0807 15:24:52.113310 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.113315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.113810 (+ 495us) server_negotiation.cc:407] Connection header received
0807 15:24:52.114001 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.114004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.114055 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.114105 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.114627 (+ 522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36008: BlockingRecv error: recv got EOF from 127.0.0.1:36008 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 15:24:52.127080 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.125437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36022 (local address 127.15.242.253:45571)
0807 15:24:52.125551 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.125556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.126075 (+ 519us) server_negotiation.cc:407] Connection header received
0807 15:24:52.126293 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.126297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.126352 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.126405 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.126967 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36022: BlockingRecv error: recv got EOF from 127.0.0.1:36022 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 15:24:52.150909 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.149061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36030 (local address 127.15.242.253:45571)
0807 15:24:52.149236 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.149243 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.149904 (+ 661us) server_negotiation.cc:407] Connection header received
0807 15:24:52.150038 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.150043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.150113 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.150221 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.150781 (+ 560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36030: BlockingRecv error: recv got EOF from 127.0.0.1:36030 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 15:24:52.186467 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.185253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36032 (local address 127.15.242.253:45571)
0807 15:24:52.185407 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.185413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.185579 (+ 166us) server_negotiation.cc:407] Connection header received
0807 15:24:52.185703 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.185706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.185765 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.185862 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.186342 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36032: BlockingRecv error: recv got EOF from 127.0.0.1:36032 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 15:24:52.254156 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.252839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36048 (local address 127.15.242.253:45571)
0807 15:24:52.253007 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.253012 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.253190 (+ 178us) server_negotiation.cc:407] Connection header received
0807 15:24:52.253352 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.253358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.253414 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.253511 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.254005 (+ 494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36048: BlockingRecv error: recv got EOF from 127.0.0.1:36048 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260807 15:24:52.386087 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.384728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36058 (local address 127.15.242.253:45571)
0807 15:24:52.384948 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.384952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.385197 (+ 245us) server_negotiation.cc:407] Connection header received
0807 15:24:52.385345 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.385347 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.385398 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.385475 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.385961 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36058: BlockingRecv error: recv got EOF from 127.0.0.1:36058 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
W20260807 15:24:52.646168 18984 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 15:24:52.644620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36060 (local address 127.15.242.253:45571)
0807 15:24:52.644842 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:52.644846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:52.644976 (+ 130us) server_negotiation.cc:407] Connection header received
0807 15:24:52.645091 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:52.645094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:52.645146 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:52.645256 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 15:24:52.645965 (+ 709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36060: BlockingRecv error: recv got EOF from 127.0.0.1:36060 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
I20260807 15:24:52.964597 19174 catalog_manager.cc:1259] Loaded cluster ID: dfc11f3929f5493a98affaaf27b70c50
I20260807 15:24:52.964699 19174 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8: loading cluster ID for follower catalog manager: success
I20260807 15:24:52.966787 19174 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8: acquiring CA information for follower catalog manager: success
I20260807 15:24:52.967473 19175 catalog_manager.cc:1259] Loaded cluster ID: dfc11f3929f5493a98affaaf27b70c50
I20260807 15:24:52.967537 19175 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878: loading cluster ID for follower catalog manager: success
I20260807 15:24:52.968261 19174 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4086da31c63f4457af498264f78efff8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 15:24:52.969359 19175 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878: acquiring CA information for follower catalog manager: success
I20260807 15:24:52.970395 19175 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9a9556984f6546638bcbb44c9fb3b878: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 15:24:53.164547 19289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:53.160202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36064 (local address 127.15.242.253:45571)
0807 15:24:53.160470 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:53.160475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:53.160629 (+ 154us) server_negotiation.cc:407] Connection header received
0807 15:24:53.160884 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:53.160887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:53.161031 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:53.161158 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:53.161446 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.161981 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.162945 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.163207 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.163330 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:53.163684 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:53.164134 (+ 450us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:53.164278 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:53.164317 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 15:24:53.164377 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":99,"threads_started":1}
I20260807 15:24:53.172518 19297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:53.168216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39792 (local address 127.15.242.252:39211)
0807 15:24:53.168498 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:53.168502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:53.168518 (+ 16us) server_negotiation.cc:407] Connection header received
0807 15:24:53.168673 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:53.168675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:53.168896 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:53.169012 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:53.169249 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.169902 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.170953 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.171223 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.171324 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:53.171640 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:53.172099 (+ 459us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:53.172202 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:53.172330 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 15:24:53.172386 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":125,"threads_started":1}
I20260807 15:24:53.180934 19305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:53.175888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33482 (local address 127.15.242.254:37915)
0807 15:24:53.176417 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:53.176423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:53.176440 (+ 17us) server_negotiation.cc:407] Connection header received
0807 15:24:53.176546 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:53.176552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:53.176739 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:53.176911 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:53.177487 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.178275 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.179243 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.179486 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.179598 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:53.179953 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:53.180343 (+ 390us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:53.180439 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:53.180594 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 15:24:53.180660 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":90,"threads_started":1}
I20260807 15:24:53.181111 19297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:53.176309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39794 (local address 127.15.242.252:39211)
0807 15:24:53.176431 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:53.176437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:53.176630 (+ 193us) server_negotiation.cc:407] Connection header received
0807 15:24:53.176841 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:53.176845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:53.176906 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:53.176975 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:53.177551 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.178123 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.179749 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.180062 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.180158 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:53.180536 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:53.180626 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:53.180701 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:53.180912 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 15:24:53.180980 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 15:24:53.181133 19289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 15:24:53.175932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36080 (local address 127.15.242.253:45571)
0807 15:24:53.176232 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0807 15:24:53.176237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 15:24:53.176593 (+ 356us) server_negotiation.cc:407] Connection header received
0807 15:24:53.176728 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 15:24:53.176731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 15:24:53.176841 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 15:24:53.176914 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 15:24:53.177322 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.178157 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.179804 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 15:24:53.180051 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 15:24:53.180175 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 15:24:53.180486 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 15:24:53.180583 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 15:24:53.180672 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 15:24:53.180897 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 15:24:53.180966 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185}
I20260807 15:24:53.184489 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18773
I20260807 15:24:53.202849 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18881
I20260807 15:24:53.215081 16331 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskB0Q6oi/build/debug/bin/kudu with pid 18997
2026-08-07T15:24:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3501 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6948 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (309224 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST